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PREFACE 



This report is an account of a three-year long series 
of studies to explore the construct validity of the Taxonoiny 
of Bducational Objectives ^ Handbook Cognitive Domain • 

A special note about the structure of this report 
should be made at the outset. The broad purpose of the study ^ 
was to test empirically the structure of the taxonomy. To ] 
do this it was necessary to construct four forms of a taxonomy-^ 
type test because none was otherwise available. The report 7) 
contains several sections which deal entirely with the test / 
development and test administration. Ordinarily, a report 
does not so heavily emphasize instrument development unless 
io is in Itself the research goal. It is not in this case 
but we did so for several reasons. We regard the taxonomy 
as a potentially valuable research device and as a compre- 
hensive description of a kind of educational objective which 
is critically important but quite Ignored when educational 
progress is evaluated. Thus, we believe that presenting the 
tests and an account of their development might lead others 
to use them experimentally and to develop vastly better ver- 
sions of them. Also, we identified some fundamental problems 
during test development which are most clearly preoented when 
embedded in the context in which they were found. The iden- 
tification of these problems and others which arose concerning 
the legitimate uses of data from the tests might Jointly 
constitute whatever contribution., if any, which inheres in 
this report. Our goal was the validation of the Taxonomy but 
our accomplishment might be nothing more than having laid bare 
problems which must be surmounted before that goal can 
seriously be pui'sued. 

The preliminary studies were supported by the 
Department of Educational Research and Testing of the Florida 
State University and b^, the Research Council of the University. 
The latter was in the form of grant-in-aid to Dr. R. P. Kropp 
and Dr. H. W. Stoker for ’^'Exploratory Studies in the Vali- 
dation and Deve].opment of Measures of Cognitive Processes.” 

The major study was supported by the U. S. Office of Education, 
Cooperative Resf,»arch Program, and the Institute of Human 
Learning and tho Department of Educational Research and 
Testing of the Florida State University. 

The Department and Institute encourage widespread 
faculty and student participation in research projects. The 
following categories of people participated in the overall 
project at one time or another during its duration. 



Project faculty. Dr. Riissell P. Kropp Dr. Howard Stoker 
servedHas co-principal investigators. Dr. vr. Louis Bashaw, 
Assistant Professor of Educational Research and Testing, served 
as a member of the project faculty from its inception until 
December 31, 1965, at which time he Joined the faculty of the 
University of Georgia. 

P articipating faculty » Dr. Thomas K. Bullock,. Department of 
Fdur^Sations of Education, and Mr. Harry D, Jackson, Department 
of Social Studies Education., assisted in selecting reading 
passages for the tajconomy-type tests which were constructed. 

Dr, Ernestine O’Connell, who was then a member of the faculty 
of the Department of Science Education and is now on the fac- 
ulty of Old Dominion College, Norfolk, Virginia, assisted in 
selecting and abridging reading passages and in writing, 
editing, and trying-out items., Drs. Donald L. Hartford, 

Edward L. Palmer, and Ian E. ail assistant professors 

in the Department of Educational Reseeirch and Testing, advised 
on the general methodology of the study and the statistical 
analyses of the resulting data. Dr. P. J. King, Associate 
Professor of Educational Rese Arch and Testing and Research 
Associate in the Institute of Hiunan Learning, consulted on 
and assisted with the analyses of data. 

Project graduate assistants . Mr. Howard R. Inglis, now of 
Ohio S^t'at e* iJhlver s ity , assfsted primarily in test construction 
and test aclminlstration. Dr. Eimnett To Kohler, now a faculty 
member at the University of Georgia, assisted primarily in 
test construction and data analyses. Mrs. Katherine A. McClure 
assisted in test administration. Mr. Lawr tnce* Moore, now an 
Education and Ti*aining Specialist with Gen ,*ral Electric in 
Daytona Beach, Florida, assisted primarily in test construction 
and administration. Mr. Isaiah Moyel, not a faculty member 
at Columbus College, Georgia, assisted in test construction. 

Mr. C. Nsii Shaw assisted in test construction, test adminis- 
tration, data analyses, and the preparation of scoring procedures 
for Evaluation and Synthesis items. Mr. Richard Sowash con- 
ducted oral problem solving studies to determine item validities. 
Mr. William R. Turner assisted in test construction, test 
administration, ajid di\ta analyses. Mr. John L. Wasik, now 
Director of Research for the Montgomery County Schools, Maryland, 
assisted in test construction, test administration, and data 
analyses , 

Non-p r oject gradu ate st udents . Dr. June S. Anderson, now a 
faculiy member aOildSIe Tennessee State College, Murfreesboro, 
Tennessee, assisted in the development of taxonoiay-type tests 
in the sciences. Dr. Peter Dunn-Rankln, now a faculty member 
at the University of Hawaii, and Mr. James Ro Swanson assisted 
in test construction. Mrs. Coleen Story assisted in teat 
construction. 



Consultants « Di*# J. Thomas Hastings Director^ Centax* for 
Instructional Research and Curriculum Evaluation, University 
of Illinois, and Dean David R. Ki'athwohl, Syracuse University, 
served as general cenisultants. 

{• 

Although he was not a consult amt to the project staff, 
we wish to acknowledge the perceptive comments and advice 
which were given to us by Dr. Joe Saupe of Michigan State 
University. 



The project required extensive data collection from 
several thousand public school students. This phase was 
admirably facilitated by the superintendents of public 
Instruction and the directors of ipiidance, testing, and 
research in each of the following counties, all of which are 
in Florida: Brevard (Titusville), Broward (Ft. Lauderdale), 

Duval (Jacksonville), Hillsborough (Tampa), Madison (Mavtlson), 
Manatee (Bradenton), Folk (Bartow), and Volusia (DeLand). 
^ring test administraticns , teachers f.'vou secondary schools 
in these counties served as proctors and in that role Invai- 
uably contributed to the project. We wish to acknowled.;ro 

the help which all these people so 

willingly gave. 

to acknowledge our apj? eclat ion to the 
^ucational Testing Service for permitt ing us to reproduce 
tests which appear in the Kit of Reference Tests. 

We wish to express our gratitude to the several 
authors and publishing companies who permitted us to adapt 
copyrighted materials for use in the reading passages 
which ^re part of the taxonomy-type tests we constructed. 
Specific acknowledgments of these permissions appear in 

Appenuices A t.l’u^ough D which contain the experjjaental test 
forms* 



04 . 4 . T» 4 ® express our appreciation to the Florida 

State University Computing Center staff members for their 

many kind services and to the Matlonal Science Foundation for 
Its support of the Computing Center. 
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Russell Po Kropp 
Howard W. Stoker 
February 28, 1966 







^SDjNG PAGE B»^KN0IOLMED 



TABLE OF CONTENTS 



Page 



PREFACE 



ill 



LIST OF TABLES. is 

Chapter 

I. PROBLEM 1 

A. Taxonoaiy of Educational Objectives* 

Handbook I: Cognitive Domain 1 



B. Specific Problems. .. o ....... .. 11 

C. Significance of the Problem, 17 

II. BACKGROUND 19 



A. Earlier Studies of the Writers. . . ; . . 19 

B, Studies Reported in the Literature. . . . 32 



III. TEST DEVELOPMENT 4l 

A. Rationale. {II 

B. Test Specifications ^*11 

C. Selection of Passages 

D. Preparation and Classification of 

Items 



E. Ad 2 iii.nistration of Preliiflinary Forms. ... 49 

Fc Analysis of Preliminai*y Foi*ms 50 

G. Problems in the Analysis of Item 



H. Preparation of Flnil Forms. ....... 55 



IV. TEST ADMINISTRATION AND SCORING 57 



A. Test Administration 57 

B. Test Scoring. 64 

V. STATISTICAL DATA ABOUT THE TAXONOMY FORMS. ... 67 

Means and Standard Deviations 6? 

B. Feliabillty a ....s... ....... 70 

C. Intercorrelations. ...... 70 

D. Cautions in Interpreting Results. .... 77 



4 



i 




i 




Chapter 

VI. ANALYSIS im PRESENTATION OF RESULTS. 

A. Hierarchical Structure. . . . . 

B. Tracis cendence of Process. . . . 

C. Psychological Structure. . . . 

B . SuDSsary ............ 

VII. SUMMARY AND RECOMMENDATIONS. .... 

A. Summary . 

B . Recommendations 



APPENDIX A 
APPENDIX B 
APPENDIX C 
APPENDIX D 
APPENDIX E 



Page 

81 

. 8l 
. 91 

.. 110 
159 

.. ^163 

.. 163 

. . 168 

. 175 









I 

8 




vm 




I 

I 




I 











' 




r-^f^itietSlt^ ‘ 




LIST OP TABLES 



Number Page 

1 Part-Score Correlation ?€atriz ..... 25 

2 Oblique Rotation of l^actor Analysis 

of Part Scores . . . 25 

3 Mean Performance on Experimental 

Tests by Process and by Grade . . « . 29 

A Mean Scores for Higher Taxonomy Levels 

When Subjects are Grouped on Combined 
Knowledge and Comprehension Scores 
(Form AS) 30 

5 Correlation Matrix 3? 



6 Rotated Factor Matrix ...... . . 37 



7 Schools in the Taxonomy Testing 

Program 58 

8 Aptitude and Achievement Means for 

Sample Schools Having Ninth-Grades 
and Feeder Schools for Sample Schools 
Without Ninth Grades ......... 59 



9 Means and Standard Deviations fcr 

Taxonomy Norms Within Grades and 
Over Schools . o ...... . ... 68 



10 Range of School Mean Scores 

Within Grade . • . . . . 69 

11 Reliability over Grades of Taxonomy 

Scores 71 

12 Intercorrelation Matrix, All 

Forms, Grade 9 72 

13 Intercorrelation Matrix, All 

Forms, Grade 10 73 

14 Intercorrelation Matrix, All 

Forms, Grade 11 ..... 74 



15 Intercorrelation Matrix, All 

Forms, Grade 12 



75 












f 



Number 

16 

17 



18 

19 

20 
21 

22 

23 

24 

25 

26 

27 

28 

29 

30 



Faga 



Intercorrelation Matrix, All 

Forms, All Grades 76 

Comparison of Mean Performance on 

Florida Taxonomy Battery ... 83 



Original Correlations and Correlations 
Corrected for Attentuatlon, Grades 9-12 . 85 

Original Correlations and Correlations 
Corrected for Attentuatlon, All Grades 
Together 86 

Results of Simplex Analyses, Atomic 

Structure and Glaciers 87 

Results of Simplex Analyses, Lisbon 

Earthqualce and Stages of Economic 

Growth . , . . 88 



Unrotated Factor Matrix, Taxonomy-Type 
Tests, Grade 9 94 

Unrotafced Factor Matrix, Taxonomy-Type 

Tests, Grade 10 .... 95 

Unrotated Factor Matrix, Taxonomy-Tvpe 

Tests, Grade 11 96 

Unrotated Factor Matrix, Taxonomy-Type 

Testis, Grade 12 97 

Factor Loadings for Factors II Through 

VI, Grade 9 . • . 98 

Factor Loadings for Factors It Through 

VI, Grade 10 * 99 

Factor Loadings for Factors II Through 

VI, Grade 11 100 

Factor Loadings for Fvactors It Through 

VI, Grade 12 7 . . 101 

Correlations Within Levels Across 

Forms, Grade 9 ....... io 4 



o 



X 





Number 



Page 



31 Cor-reiation within Levels Across 

Forms, Grade 10 . 105 

32 Correlations Within Levels Across 

Forms, Grade 11 . 106 

33 Correlations Within Levels Across 

Forms, Grade 12 107 

34 Correlations Within Levels Across 

Forms, All Grades 108 

35 Kit of Reference Tests Administered 

and Factoi's Identification 112 

36 Reliability Estimates for Twenty- 

four KIT of Reference Tests 113 

37 Unrotated Factor M?itrlx$ Kit of 

Reference Tests, Grade 9 . ^ .... 113 

38 Unrotated Factor Matrix; Kit of 

Reference Tests, Grade 10 119 

39 Unrotated Factor Matrix; Kit of 

Reference Tests, Grade 11 120 

40 Unrotated Factor Matrix; Kit of 

Reference Tests, Grade 12 121 

41 Rota'jed Factor Matrix; Kit 5f 

Refe pence Tests, Grade 9 • ..... 122 

42 Pota ;ed Factor Matrix; Kit 5 f 

reference Te^ts, Grade 10 123 

43 Rotated Factor Matrix; Kit- of 

Reference Tests, Grade 11 124 

44 Rotated Factor Matrix; Kit of 

Reference Tests, Grade 12 ..... 125 

45 Factor Loadings: Number Facility . . 126 

46 Factor Loadings: Associative Memory . 126 

47 Factor Loadings: Speed of Closure. . 127 

xi 









A 






Number 

48 

49 

50 

51 
51a 

52 

53 
- 54 






56 

57 

58 

59 

60 

60a 



6l 



61a 



62 



Page 

Factor Loadings J Fluency . . 127 

Factor Loadings: Verbal Reasoning .... 128 

Factor Loadings: Flexibility of Closure » . 129 

Factor Loadings:. Reasoning 129 

Factor Loadings: Fluency in Making 

Verbal Trajisformation 130 

Common Factors Appearing Only at 

Grads 9 . . . . 131 

Common Factors Appearing Only at 

Grade 10 132 

Comiaon Factors Appearing Only at 

Grade 11 133 

Common Factors Appearing Only at 

Grade 12 . . » . 134 

Regression Analyses, Grade 9 135 

Regression Analyses, Grade 10 136 

Regression Analyses, Grade 11 ...... 137 

Regression Analyses, Grade 12 ...... 138 

Summary of Significant Beta Weights, 

Grad^'i? •••'>• 139 

Summary of Predictors of Level Scores, 

over Forms by Grades with Significant 

Beta Weights, Grade 9 . 140 

Summary of Significant Beta Weights, 

Grade 10 . I4l 

SuiOiary of Predictors of Level Scores, 

over Forms by Grades with Significsmt 

Beta Weights, Grade 10 . . 142 

Summary of Significant Beta Weights, 

Grade 11 ..... 143 



o 

ERIC 



xil 















Number Page 

62a Summary of Predictors of Level Scores, 
over Forms by Grades with Significant 
Beta V/eights, Grade 11 ........ . 144 

63 Summary of Significant Beta Weights. 

Grade 12 . 145 

639^ Summary of Predictors of Level Scores, 
over Forms by Grades with Significant 
Beta Weights, Grade 12 ........ . 146 

64 Named KIT Factors by Grade . 147 



o 

ERIC 



xiii 



t 



I. EROBLEH 



This S6C'bjLon consists s ol* 8 l dGscription of* th© Tsixononiy 

of Sduca tlpj^l Objectives > Handbook I; Cognitive Domain ^ 
(Bloom, 1956), a statement of. the problem which was studied, 
and some remarks about its significance. 

The description of the Taxonomy is somewhat extended 
because it constitutes the single document of interest in 
the study. Particular attention is devoted to those parts 
of it which deal with the rationale for the structure of the 
taxonomy and which deal with the, taxonomists* conception of 
cognitive aptitude or ability and its generality. The 
condensed version of the Taxonomy appears in this section 
as an aid to the reader and through the gracious permission 
of the publisher. 



A. Taxonomy of Educational Objectives, 

Handbook I; Cognitive Domain 

Part I of the Taxonomy describes the history of the 
development of the taxonomy. The reader viho desires a 
comprehensive account should refer to it. What follows is 

a condensation of those parts of it which are most relevant 
to this study. 

In 19^8 a group of collegse examiners conceived the 
idea of developing a classification system for educational 
objectives. The purpose of it would be to facilitate 
communication among them about test items, educational 
objectives, and testing procedures. Hitherto, communication 
among them was impaired by the lack of a standardized 
vocabulary and conceptual framework. 

The group conceived three classification systems, ^ 
each in a different domain of behavior; cognitive, affective, S 
and psychoraotor • The first to be completed was the cognitive > 
domain and one thousand copies of it were printed and 
distributed in a preliminary edition. It was distributed 
to public school and college educators, and others with 
the request that it be criticized. These criticisms were 
then taken into account in preparing for publication the 
version which is cited here. 

Several decisions which the college examiners made 
in order to prepare the taxonomy are relevant to this study. 
These are described briefly below but more complete discussions 
of them appear in subsequent parts of the report. 



The developers agreed that as a first priority the 
classification scheme or taxonomy should reflect distinctions 
teachers make about student behaviors. As a second priority, 
they agreed that the taxonomy should be logically developed 
and internally consistent. Third, the classification scheme 
should be consistent with present understanding of psychological 
phenomena. And, finally, the classification scheme should be 
descriptive and it should be neutral as regards educational 
philosophies. Some implications of these discussions are 
mentioned in the Taxonomy (Bloom, 1956, pp. 13-15). It is 
noteworthy that prime attention was accorded producing a 
taxonomy which would be educationally meaningful. This emphasis 
is congruent with the difficulties they had previously 
experienced in communicating about test problems. Since this 
was a conscious decision, and seemingly a very sensible and 
defensible one, the developers were certainly aware that in 
some instances logical and psychological relevance, technical 
excellence, and comprehensiveness might have to be partially 
sacrificed to achieve educational meaningfulness. 

They had to choose the phenomena on which to develop 
the taxonomy. Their choice was the student behavior which a 
test item is intended to elicit . In reaching this decision, 
they discarded other phenomena like subject matter, educational 
pocesses, and, more especially, student behavior which an 
item actually evokes. In this latter regard, they acknowledged 
that the behaviors which an item is intended to evoke and 
those which it actually evokes might be different due to prior 
experiences of the examinees. 

The taxonomists then decided that the intended behaviors 
or processes could be categorized into broad groups and within 
each group into specific subgroups. They then arranged these 
broad groups of behaviors or processes in what they believed to 
be an hierarchical structure. 

The structure was presumed to be hierarchical on the 
basis that behaviors which defined the first broad category 
were regarded as being integrated with new behaviors in the 
next higher category, and that the integration of these 
behaviors and new behaviors represented the next higher 
category, etc. In addition, the specific subgroups of a 
broad group were arranged according to complexity, if not 
hierarchically. 



The resulting taxonomy, in a condensed form, appears 
below with the permission of the publisher and is taken Intact 
from the Taxonomy (Bloom, 1956, pp. 201-207). 
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Condensed Version pf 
Taxonomy of Educational Objectives 

Cognitive Domain 

KNOWISDGE 



1.00 KNOWLEDGE 

Knowledge, as defined here, involves the recall of 
specifics and universals, the recall of methods and 
processes, or the recall of a pattern, structure, 
or setting. For measurement purposes, the recall 
situation involves little more than bringing to 
mind the appropriate material. Although some 
alteration of the material may be required, this 
is a relatively minor part of the task. The 
knowledge objectives emphasize most the psychological 
processes of remembering. The process of relating 
is also involved in that a knowledge test situation 
requires the organization and reorganization of a 
problem such that it will furnish the appropriate 
signals and cues for the information and knowledge 

possesses. To use an analogy, if 
one thinks of the mind as a file, the problem in 
a knowledge test situation is that of finding in 
the problem or task the appropriate signals, cues, 
and clues which will most effectively bring out 
whatever knowledge is filed or stored. 

1*10 KNOWLEDGE OP SPECIFICS 

The recall of specific and isolable bits of infor- 
mation. The emphasis is on symbols with concrete 
referents. This material, which is at a very low 
leve. of abstraction, may be thought of as the 
elements from which more complex and abstract forms 
of knowledge are built. 



1.11 knowledge op terminol ogy 

Knowledge of the referents for specific symbols 
(verbal and non-verbal). This may include knowl- 
eage of the most generally accepted symbol ' 

^^4 knowledge of the variety of symbols 

which may be rised for a single referent - or 
knowledge of the referent most appropriate to 
a given use of a s^rmbol. 
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define technical terms by giving their 
attributes, properties, or relations. 

^^^Famlliarity with a large number of words In 
their common range of meanings. 

Iel2 KNOyfLEDGE OP SPECIFIC PACTS 

Knowledge of the dates, events, persons, places, 
etc. This may Include very precise and specific 
informatiDii such as the specific date or exact 
magnitude of a phenomenon. It may also include 
approximate or relative information such as an 
approxims^te time pex*iod or the general order of 
magnitude of a phenomenon. 

*The recall of major facts about particular 
cultures . 

*The possession of a minimum knowledge about 
the organisms studied in the laboratory. 

Io20 KNOWLEDGE OF WAYS AND MEANS OP DEALING 
WifH" SfE CIilCS 

Knowledge of the ways of organizing, studying. 
Judging, and criticizing. This includes the 
methods of inquiry, the chronological sequences, 
and the standards of Judgment within a field as 
well as the patterns of organization through which 
the areas of the fields themselves are determined 
and internally organized. This knowledge is at 
an intermejdiate level of abstraction between 
specific Jcnowledge on the one hand and knowledge 
of universals on the other. It does not so 
much demand the activity of the student in using 
the materials as it does a more passive awareness 
of their nature. 

1.21 KN OWLEDGE OP CONVENTIONS 

Knowledge of characteristic ways of treating and 
presenting ideas and phenomena. For purposes of 
communication and consistency, workers in a field 
employ usages, styles, practices, and forms which 
best suit their purposes and/or which appear to 



o 



^^Illustrative educational objectives selected from 
the literature. 
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suit best the phenomena with which they deal* It 
should recognised that although these fonris and 
conventions are likely to be set up on arbitrary » 
accidental, or authoritative bases, they are 
retained because of the general agreement or 
concurrence of individuals concerned with the 
subject, phenamena, or problem. 

^'familiarity with the forms and conventions 
of the major types of works, e.g., verse, 
plays, scientific papers, etc. 

*To make pupils conscious of correct form and 
usage in speech and writings 

1.22 KNOWLEDGE OP ‘PRENDS AND SEQPENCK S 

Knowledge of the processes, directions, and move- 
ments of phenomenfi with respect to time. 

*Under standing of the continuity and develop- 
ment of American culture as exemplified in 
American life. 

^Knowledge of the basic trends underlying the 
development of public assistance programs. 

1.23 KNOWLEDGE OP CLASSIFICATIONS AND CATEGORIES 

Knowledge of the classes, sets, divisions, and 
arrangements which are regarded as fundamental for 
a given subject field, purpose, argument, or problem. 

•To i:ecognlze the area encompassed by various 
kinds of problems or ^fAterials. 

•Becoming familiar with a range of types of 
literature « 

1.24 K^ IOWLEDGE OF CRITErJA 

Knowledge of the criteria by which facts, principles, 
opinions, and conduct are tested or Judged. 

•Pasniliarity with criteria for Judgment appro- 
priate to the type of work and the purpose for 
which it is read. 

•Knowledge of criteria for the evaluation of 
r acreat ional act Ivlt i^s , 
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1.25 KNOWLEDGE OF METHODOLOGY 

Knowledge of the methods of inquiry, techniques, 
and procedures employed in a particular subject 
field as well as those employed in investigating 
particular problems and phenomena. The emphasis 
here is on the individual’s knowledge of the 
method rather than his ability to use the method. 

^Knowledge of scientific methods for eval- 
uating health concepts. 

*The student shall know the methods of attack 
relevant to the kinds of problems of concern 
to the social sciences. 

1 . 30 KNOWLEDGE OF THE DNIVERSALS AND ABSTRACTIONS 

IN A FIELD ~ 

Knowledge of the major schemes and patterns by 
which phenomena and ideas are organized. These 
are the large structures, theories, and general- 
izations vjhich dominate a subject field or which 
are quite generally used in studying phenomena 
or solving problems. These are at the highest 
levels of abstraction and complexity. 

1.31 KNOWLEDGE OP PRINCIPLES AlH) GENERALIZATIONS 

Knowledge of particular abstractions which summarize 
observations of phenomena. These are the abstractions 
which are of value in explaining, describing, pre- 
dicting, or in determining the most appropriate and 
relevant asJilon or direction to be taken. 

^Knowledge of the important principles by which 
our experience with biological phenomena is 
summarized. 

*The recall of major generalizations about 
particular cultures. 

1.32 KNOWLEDGE OF THEORIES AND STRUCTURES 

Knowledge of the body of principles and generalizations 
together with their interrelations which present a 
clear, rounded, and systematic view of a complex 
phenomenon, problem or field. These are the most 
abstract formulations, and they can be used to show 
the interrelation and organization of a great range 
of specifics. 
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*The re-call of major theories about particular 
cultures . 

•Knowledge of ii relatively complete formulation 
of the theory *>f evolution, 

INTELLECTUAL ilBILITIES AND SKILLS 

Abilities and skills; refer to organissed modes of 
operation and g;eneralized techniques for dealing 
with materials and problems. The materials and 
problems may be of such a nature that little or 
no specialized and technical information is 
required. Such information as is x^equired can 
be assumed to be part of the individual’s general 
fund of knowledge. Other problems may require 
specialized and technical information at a rather 
high level such that specific ilmowledge and skill 
in dealing with the problem and the materials are 
required. The abilities and skills objectives 
emphasize the mental processes of organizing and 
reorganizing material to achieve a particular 
purpose. The materials may be given or remembered. 

2,00 COMPREHENSION 

This represents the lowest level of understanding. 

It refers to a type of understamdlng or apprehension 
such that the individual knows what is being 
communicated and can make use of the material or 
idea being communicated without necessarily relating 
it to other material or seeing its fullest 
implications, 

2,10 TRANSLATION 

Comprehension as evidenced by the care and accuracy 
with which the communication is paraphrased or 
rendered from one language or form of communication 
to another. Translation is judged on the basis of 
faithfulness and accuracy , that is, on the extent 
to which the material in the original communication 
is preserved although the foxmi of the communication 
has beei altered, 

•The ability to understand non-literal state- 
ments (metaphor, symbolism, irony, exaggeration), 

•Skill in translating mathematical verbal 
material into symbolic statements and vice 
versa. 




2.20 INTERPRETATION 

explanation or summarization of a comunication. 
Whereas translation involves an objective part-for- 
part rendering of a communication, interpretation 
involves a reordering, rearrangement, or a new view 
or the material. 



»The ability to grasp the thought of the work 
as a whole at any desired level of generality. 

*The ability to interpret various types of 
social data. 



2.30 EXTRAPOLATIO N 



The extension of trends or tendencies beyond th<=^ 

detemlne Implications, consequences, 
etc.. Which are in accordance 
m the original 



*The ability to deal with the conclusions of 
a work in terms of. the immediate inference 
made from the explicit statements. 



*Skill in predicting continuation of trends. 

3.00 APPLICATION 

oit abstractions in particular and concrete 

situations. The abstractions may be in the form 

procedures, or generalized 

technical 

principles, ideas., and theories which must be 
remembered and applied. 



^Application to the phenomena discussed in 
one paper of the scientific terms or concepts 
used in other papers. 

*The ability to predict the probable effect 
Of a change In a factor on a biological 
situation previously at equilibrium. 

^ . 00 ANALYSIS 



® Communication Into its constituent 
Pa^ts such that the relative hierarchy 
Oi Ideas is made clear and/or the relations between 
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the ideas expressed are made explicit. Such analyses 
are Intended to clarify the communication, to indi- 
cate how the communication is organized, and the way 
in which.it manages to convey its effects, as well 
as its basis and arrangement. 

4 . 10 ANALYS I S OP E LEMENTS 

Identif icatJ on of the elements Included in a communi- 
cation. 



*The ability to recognize unstated assumptions. 

*Skill in distinguishing facts from hypotheses. 

4.20 ANALYSES OP RELATIONSHI PS 

The connections and interactions between elements 
and parts of a communication. 

^Ability to check the consistency of hypotheses 
with given Information and assumptions. 

»Skill in comprehe.iding the interrelationships 
among the ideas in a passage. 

4.30 ANALYSIS OP ORGANIZATIONAL PRINCIPLES 

The organization, systematic arrangement, and structure 
which hold the communication together. This includes 
the “explicit” as well as “implicit” structure. It 
inclr^'es the bases, necessary ai’rangement , and the 
mechanics which make the communication a unit. 

•The ability to recognize form and pattern in 
literary or artistic works as a rneauis of 
understanding their meaning. 

•Ability to recognize the general techniques 
used in persuasive materials, such as adver- 
tising, propaganda, etc, 

5.00 SYNTI-IESIS 

The putting together of elements and parts so as to 
foi*ra a whole. This involves the process of working 
with pieces, parts, elements, etc., and arranging 
and combining them in such a way as to constitute a 
pattern or structure not clearly there before. 
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5.10 PROD UCTION OP A ON I QOE COM HDNICATION 

The development of a commimication in which the 
writer or speaker attempts to convey ideas, feelings, 
and/or experiences to others e. 



*Skill in writing, using an excellent organi- 
zation of ideas and statements* 

•Ability to tell a personal experience effectively. 

5.20 PRODUCTION OP A PLAN, OR PROPOSED SET OF 
Q!>£ftATIONS 

The devexopment of a plan of work or the proposal of 
a plan of operations. The plan should satisfy 
requirements of the task which may be given to the 
student or which he may develop for himself. 

•Ability to propose ways of testing hypotheses. 

•Ability to plan a unit of Instruction for a 
particular teaching situation. 

5.30 ^IVATION OP A SET OP ABSTRACT RELATIONS 

The development of a set of abstract relations either 
to classify or explain particular data or phenomena, 
or the deduction of propositions and relations from 
a se./ of basic propositions or symbolic representations. 

•Ability to formulate appropriate hypotheses 
based upon an analysis of factors Involved, 
and to modify such hypotheses in the light 
of new factors and considerations. 

^Ability to make mathematical discoveries and 
generalizations . 

6.00 E VALUATION 

Judgments about the value of material €uid methods for 
gl\^en purposes. Quantitative and qualitative iudg- 
ments about the extent to which material and methods 

0 ^ standard of appraisal, 

may b© those determined by the student 
or those which are given to him. 
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6.10 JUDGiynSNTS IN TERMS OP INTERNAL EVIDENCE 



Evaluation of the accuracy of a communication from 
such evidence as logical accuracy, consistency, and 
other interjrsal criteria « 

♦Judging by internal standards, the ability to 
assess general probability of accuracy in 
reporting facts from the care given to exact- 
ness of statement, documentation, proof, etc. 

♦The ability to indicate logical fallacies in 
argiaments 

6.20 JUDGMEITPS IN TERMS OF EXTERNAL CRITERIA 

Evaluation of material with reference to selected or 
remembered criteria. 

♦The comparison of major theories, general- 
izations, and facts about particular cultures. 

♦Judging by external standards, the ability to 
compare a work with the highest known standards 
in its field— especially with other works of 
recognized excellence. 



B. Specific Problems 

The study focused on three specific problems: (a) to 

test the hierarchical structure of the taxonomy; (b) to 
determine whether the six major processes, aptitudes, or 
abilities which are described in the taxonomy transcend 
subject matter content; and (c) to determine the psychological 
structure of each of these major processes or abilities. 

Each of these problems is described below. 



Hierarchical Structure 

The developers of the taxonomy regard its structure 
as hierarchical. Consider the following. 

We proceeded to divide the cognitive objec- 
tives into subdivisions from the simplest behavior 
to the most complex, 

4*0, SC' long as the simpler behaviors may be 
viewed as components of the more complex behaviors. 
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we can view the educational process as one of 
building on the simpler bol vior. 

In order to find i single place for each 
type of behavior, the taxonomy must be organized 
from simple to complex classes of behavior* 

Our attempt to arrange educational behaviors 
from simple to complex was based on the idea that 
a particular simple behavior may become integrated 
with other equally simple behaviors to form a more 
complex behavior, ‘fhus our classifications may be 
said to be in the form where behaviors of type A 
foi*m one class, behaviors of type AB form another 
class, while behaviors of type ABC form still 
another class. If this is the real order from 
simple to complex, it should be related to an order 
of difficulty such that problems requiring behavior 
A alone should be answered correctly more frequently 
than problems requiring AB. We have studied a 
large number of problems occurlng in our compre- 
hensive exciminations and have found some evidence 
to support this hypothesis. Thus, problems re- 
quiring knowledge of specific facts are generally 
answered correctly more frequently than px'Oblems 
requiring a knowledge of the universals and abstrac- 
tions in a field. Problems requiring knowledge of 
principles and concepts are correctly answered 
more frequently than problems requiring both knowl- 
edge of the principle and some ability to apply 
it in new situations. ...Our evidence on this is 
not entirely satisfactory, but there is an unmis- 
takable trend pointing toward a hierarchy of classes 
of behavior which is in accordance with our present 
tentative classification of these behaviors (Bloom, 
1956 , pp. 15 - 19 ). 

These quotations document the belief of the developers 
that the taxonomy is cumulatively hierarchical. Consequently 
this feature is a salient characteristic of the taxonomy and 
is the point of entry for one who wishes to determine its 
construct validity. If such a structure cannot be demon- 
strated, at least relatively, then the usefulness of the 
taxonomy is clouded. 

This claim or intention of a cumulative hierarchy can 
be investigated providing that data are available from tests 
which are constx*ucted according to the taxonomy or can be 
anaiyzea in acocrdance with it such that separate scores for 
each of the six major levels can be obtained. • Because tests 
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of these kinds were not commercially available at the 
inception of the project, and for that matter are still not 
available, the initial major undertaking was to construct 
such instruments. The presumed structure can be used 
to generate hypotheses about the probable nature of data 
from such tests. These hypotheses are stated generally 
here but detailed discussion of them and the adequacy of 
the statistical tests of them appears later in the report. 

First, if a test is constructed so that it contains 
equal numbers of items corresponding to each of the six 
major levels of the taxonomy and if the content of all items 
represent a sample from a described universe of content, then 
means of level scores should decrease as the complexity of 
the level Increases, l.e., the mean for Knowledge scores 
should be greater than the mean for Comprehension scores, 
etc., with Evaluation scores having the smallest mean. 

There are certain assumptions on which this hypothesis 
is based. For the hypotheses to hold, then item complexity 
must be synonymous with item difficulty, the obtained raw 
score distribut j.ons must closely resemble the true score 
distributions, and ail behaviors which students perform when 
responding to items must be in the universe of behaviors 
defined by the taxonomy. 

Second, within the restrictions on a test as described 
in the first hypothesis, an Intercorrelation matrix of major 
level scores should exhibit simplical structure when judgea in 
terms of the claimed structure. This is a reasonable expec- 
tation because the developers essentially claim that th& 
structure is as follows: 



Category 

Knowledge 

Comprehension 

Application 

Analysis 

Synthesis 

Evaluation 



Abilities 

a 

a+b 

a+b+c 

a+b+c+d 

a'**b+c+d+e 

a+b+c+d+e4*f 



Consequently, adjacent categories of the taxonomy should be 
more highly correlated than non-ad jacent pairs of categories 
and the correlations should decrease as the distance between 
categories increases. 



The technical description of this is as follows, and 
Is taken from Quttman*s aiscussion of the Radex theory 
(Guttman, 195^) « If a perfect simplex exists, then certain 
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partial correlations will vanish. In particular, j = 0 
for i<J <k. These partials vanish only if the numeraiors 
equal zero, i.e. 



^ik * ^ij^jk> where i< j <k 

In a perfect simplex this relationship holds for all i, j, 
and k. If this relationship is satisfied, the correlation 
matrix will be such that the largest values will lie along 
the upper-left, lower-right diagonal, followed by the next 
larger values in the adjacent diagonals and the smallest values 
in the upper-right smd lower-left corners of the matrix. The 
relationship is such that the column totals in a perfect 
simplex will be smallest at the left and right extremes and 
highest for the central columns. When the correlation matrix 
approaches the simplex but does not satisfy the rigorous 
requirement of the perfect simplex, the matrix may be classed 
as quasi-simp lex. 



Transcendence of Processes 

When constructing the taxonomy the developers were 
confronted with the problem of designating the phenomena to 
be classified. The choice which they made is described in 
the following paragraph. 

We are of the opinion that although the objec- 
tives and test materials and techniques may be specified 
in an almost unlimited number of ways, the student be- 
haviors Involved in these objectives can be represented 
by a relatively small number of classes. Therefore, 
this taxonomy is designed to be a classification of the 
student behaviors which represent the intended outcomes 
of the educational process. It is assumed that essen- 
tially the same class of behavior may be observed in the 
usual range of subject-matter content, at different 
levels of education (elementary, high-schooi, college), 
and in different schools. Thus, a single set of clas- 
sifications should be applicable in all these Instances 
(Bloom, 1956, p. 12). 

The assertion in the last sentence implies that the 
abilities, behaviors, or processes described in the taxonomy 
transcend content. When reduced to the context of a single 
test item and with great simplication the argument is that 
the student response to a test item is the interaction of two 
relatively Independent dimensions of behavior, content and 
process. The student when confronted with a test item must 
first identify the appropriate content or subject matter which 
the item problem requires, and then, second, he must use the 
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relevant process to maiilpulate the content in order to produce 
a response to the Iteni* Thus^ the assertion is that mental 
or cognitive operators are applicable to or general over all 
contents. Analysis in history. Analysis in geometry, and 
Analysis in foreign language are different so far as the 
content goes but the cognitive processes which are applied to 
the content are identical. 



4 ^ 52 appropriate hypothesis for testing this assertion 

is that if several taxonomy-type tests are available, each 
dealing with a different content , and each yielding separate 
scores for each level of the taxonomy, then the Intercorre- 
scores dealing with the same process over several 
contents will be greater than the correlations between the 
processes on the same content. The most direct 
method of testing this hypothesis is to submit the Intercor- 
reiation matrix of all process scores, where each process- 
content combination is regarded as a test viiriable. to 
clrcumplex analysis (Guttman, 1954). 



The uniform, perfect, additive 
as follows: 



clrcumplex is described 



If a uniform clrcumplex exists, then 

®11 + ®2i + (®J1 +••+ Cnl) n-a+D 

where tjj represents a test (tj) with elementary additive 

components (oi). If we assume that all elementary components 
to be unoorrelated. l.e.. 



%Cp "• 0 (p q) 



and consider the special case where all element 
have equal variance and where m >n/2 then; 



ary components 




1 - 



m 

m 



0 < k-j < n-m 
n-nr< k-J <n 



int ere orrelat ions which satisfies these 
f unique characteristics; the colum 

equal, and each row of the table will have th 
s^e entries as the preceding row, but moved one space to th 

to the beginning, in the case 
where the clrcumplex Is not equally-spaced, then the column 
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totals will not be equal. The matrix can then no longer be 
considered a circulant. It is possible to define a quasi- 
circumplex in the same manner as a quasl-simplex is defined.* 



Psychological Structure 

The third specific problem is to explore the psychological 
structure of the taxonomy. The reader will recall that three- 
criteria in constructing the taxonomy were educational meaning- 
fulness, logical rigor, and psychological meaningfulness, in that 
order of priority. It is the latter characteristic upon which 
this specific aspect of the study focuses. 

The major objectives were (a) to determine the kinds 
of cognitive aptitudes, as defined by tests in the Kit of 
Reference 'jests (French, Ekstrora and Price, 1963), and their 
regression weights, which are related to scores attained on 
tests of each level of the taxonomy, (b) to determine if these 
equations for a given level, but calculated over different 



* Parenthetically there appears to be an inconsistency 
in the taxonomy. On the one hand, the behaviors are regarded 
as being general over content. On the other hand, the Knowl- 
edge category is seemingly defined as the content on which 
the processes are to be exercised. Strictly speaking? it would 
seem that the Knowledge category should be defined simply as 
the process of recall or remembering. Unfortunately, if one 
does so, then he encounters difficulties perhaps more serious 
than those posed by the seeming inconsistency.^ Specifically, 

It seems that the measurement of recall cannot be separated 
from the measurement of content. For example, if one asks. 

In wiiau y63j?^ did Columbus discover Aniericci?** ctnd he receives 
no response, tasn one cannot with a.ssurance ascribe the failure 

5?°^ having stored that bit of inf or- 
mav/lon or his xnability to recall it from storage if in fact 

However, if the item is changed to **In what 
between 1400 and 1500 did Columbus discover America?” 
student responds ”1492”, then one would probably grant 
that the relevant content was in storage and the process of 

should be noted that the addition 
of ”between 1400 and 1500” altered the stimulus value of the 
item. 4.nus, a question is raised about what the Knowledge 
category of the taxonomy should be. Should it be "stored 
content as it seems to be at present or should it be "the 
relative accessibility of stored content”? The latter would 
seem to be more consistent with the other major categories of 
the taxonomy. At any rate, it poses an interesting research 
question. Because of the question raised here, this study was 
structured so that this point would not be a crucial one: 
^nevertheless, it deserves attention. 

ERIC 
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contents, are similar. or,-dlssimilar, (c) to determine the 
changes in factors and weights in the equations for each of 
the several levels of the taxonomy, for different contents 
separately, and (d) to determine the similarity of equations 
for the same level of the taxonomy but calculated on different 
grade-groups of students. 

Jointly these, studies should reveal the structure of 
the taxonomy in terms of more elemental cognitive aptitudes, 
whether process transcends content, whether the structure of 
the taxonomy. as defined by these regression equations is a 
function of the grade-level of students or is Independent of 
it, and whether there are systematic changes in the regres- 
sion equations from level to level of the taxonomy. 



C. Significance of the Problem 

The taxonomy is receiving increasingly wider use in 
education. The current uses go far beyond merely facilitating 
communication about ^,educ at ional objectives. These include 
establishing, series of educational objectives which are 
ordered ostensibly according to increasing complexity, the 
analyses of educational behaviors into the taxonomic clas- 
sification, exploratory experimentation in the development 
of Instructional programs intended to foster cognitive devel- 
opment, etc. Although these uses constitute Justifiable 
commonsense employment of the taxonomy, it does seem that 
their legitimacy rests on the assumption that the taxonomy 
structure is verifiable* It is the Intention of this project 
to initiate these valldational studies. 

• * * . * 

It should be acknowledged immediately that we have a 
serious reservation about the propriety of our effort to 

taxonomy. The developers of the taxonomy state 
that the phenomena to be classified are ^‘intended student 
behaviors,” i.e., the behaviors which an item is Intended to 

state that the phenomena are not the behaviors 
which students actually execute when responding to a test 

holds rigorously to their stipulation, then the 
validity of the taxonomy rests on the agreement among raters 
in designating the behaviors which an item is Intended to 
evoke. Therefore, the actual student behaviors are irrelevant 
in the validation process. We acknowledge the distinction 
between intended behaviors and actual behaviors which they 
drew, but have chosen to proceed on the assumption that the 

taxonomy in educational planning and research 
depends upon the empirical demonstration that the structure of 
the taxonomy portrays actual student behaviors. Consequently, 
the analyses presented herein and the interpretation of the 
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results of them should be considered as relevant to our 
re-deflnition of the phenomena to be classified* Thus, the 
results do not necessarily bear cn the validity of the 
taxonomy imen considered in terms of the announced purpose 
of the taxonomists* 

The validation of the taxonomy would have several 
distinct theoretical and practical advantages* First, it 
would enable those who use it In the Intended sense to do 
so with greater confidence* Second, it would provide a sound 
basis on which to develop sequential educational programs 
5.ntended foz^ the systematic development of increasingly more 
complex objectives* Third, if the processes are found to be 
general over content, then the processes themselves might be 
considered as desirable educational objectives for no other 
reason than their pervasive arid enduring nature imd the 
temporality of most content* Fourth, it would provide a 
novel theoretical fr/imework in which to consider certain 
educational problems; e.g*, educational under achievement 
might become amenable to study as a phenomenon which is 
explainable on the basis of cognitive disability of under- 
development of a nonorganic and nonpat hologlcal kind, instead 
of on the prevalent but somewhat secondary ground of invoking 
social and emotional variables as the primary explanatory 
concepts* Fifth, if it can be demonstrated that the major 
levels of the taxonomy are unique arrangements of known 
aptitudes which pervade all levels or if it can be shown 
that each succeeding level is explainable by an increasingly 
larger set of aptitudes, then a new research avenue will be 
opened which might lead to the deliberate development of 
broad aptitudes or processes and perhaps the expeitoental 
creation, through novel instructional programs, of aptitudes 
which have not yet been identified. 










II . BACKGROUND 



/> 



.. * . consists of two major parts. The 

Irst deals with related studies which the Investigators 
inducted Immediately prior to the study reported herein, 
^e second deals with a survey of the reported research on 

?f® P^’esented separately because most 
f earlier studies by the authors do not 

appear In the .literature and because the present studv 
Is an outgrowth of them. ' 



A. Earlier Studies by the Writers 

i-ho received a grant-ln-ald from 

the Graduate Council of the Florida State University for 

Studies In the validation of measures of 

studies were undei’t.aken 

determine Whether test Items could be classified 

to^detaLi?na°fw^”®fc^° ^^® levels Of the taxonomy and 

to determine the characteristics of test data when 

eonaBn«2”^** according to levels of the taxonomy. As a 

f ^^®?* ® ^^^**'* <^he construction and 

Lch Is teLrEerLlfw!'‘*°”°“^"^’^^ "®® undertaken. 

Item 

taxonoB^ soor®s, centered on the Reading Test and the 

^68^= Of the advanced battery of the 

of^seven^a^r.e°^^®^f"®"^ '^®®*®' Test conslsts 

hv vnn« reading passages each of which Is followed 

by four to nine four-choice Items. There are fortv-four 

consists of*fortv*five^i\ Computation Test 

mni-nrv?? items dealing with subtraction, 

multiplication, and division of mixed, whole, and decimal 

numbers; calculation of interest rates, volumes areas 
percentages; calculations based on data presented In^ * 

booklet but the answer sheet provides two 
given^^”^^ responses; DK, "don’t know,” and NG, ”not 



Classification of Items by Judges 

Bg §<^^ng test . The forty-five items of the Reading Test 
were sorted according to the six major leveirof the 
taxonomy by two sets of Judges. All Judges were familiar 



o 
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with the taxonomy. Seven of the eight Judges had at least 
three years of graduate Instruction in tests and measurements 
and the other Judge was a third-yean? doctoral student who 
minored in tests and measurements. The Judges were asked 
to classify each item according to the major levels of the 
taxonomy. They worked Independently and each had available 
a copy of the Taxonomy and a test booklet which contained 
the items and reading passages. A set of five of the Judges 
sorted the items initially, then four months later a second 
set — three of the original Judges and three additional 
ones— classified the same items. 

V/hen the modal classification of an item by 
each set of Judges is considered, then only five of the 
forty-four items received different modal classifications 
by the two sets of Judges; e.g., the modal Judgment of one 
set was Knowledge, 8uid the modal Judgment of the other was 
Comprehension; twenty-four items received the same modal 
classification by both sets of Judges; and five were nearly 
similar in that one set reached a bimodal classification 
whereas the other set reached a modal classification which 
corresponded to one of the levels in the others’ bimodal 
classification. However, it should be noted that three of 
the Judges were common to both sets and four months elapsed 
between the two sortings. 

The first set of Judges gave modal classification 
to items as follows: Knowledge, ten items:; and Comprehension, 

twenty-nine items. They reached the folloiilng bimodal 
classifications: Knowledge-Comprehension, two items; 

Comprehension-Analysis, two items; and Comprehension- 
Synthesis, one item. The second set of Judges classified 
modally ten items as Knowledge and twenty-two items as 
Comprehension, and eleven items were classified bimodally 
as Knowledge-Comprehension. 

* 

The extent to which Judges spread their ratings 
over items is as follows. The first set of Judges used 
only one or two levels of the taxonomy to classify thirty- 
one items, and only three or four levels to classify the 
remaining thirteen items; however, only oriQ item was 
classified In four levels. The second set of Judges 
used one or two categories or levels with thirty-six 
items and three categories with the remaining eight items. 

The three Judges who were common to both sets 
of Judges gave exactly the same rating at both times to 
only eight items; i.e., they agreed completely with each 
other at one time, then agreed completely the second 
time, and the ratings at both times were Identical. 
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For eighteen items, each Judge gave the same rating at 
both times; for twenty-one items, only two Judges gave 
the same rating at both times, and on five items Just one 
of them gave the same rating at both times. 

The phenomena on which the taxonomy is based is 
the behavior which an item is intended to elicit. The 
description of the agreements and disagreements among 
Judges which are presented above suggest that there is 
substantially less agreement among them than one would 
expects To a great extent their disagreements can be 
rationalized on three bases which were revealed in group 
discussions with them. First, they did not use the same 
frame of referehctt^ Second, apparently some of the items 
can be solved by several processes each of which appears 
at a different level of the taxonomy. Third, the limited 
range of cognitive process represented in the Reading Test 
probably speciously magnified differences among them. 

The failure of Judges to share a common frame of 
reference might be illustrated by the following item. 

“Which of the following words is a synonym for the word 
’lazy*"? Some Judges might classify the item as Knowledge 
because they believe that the typical student for whom 
the test is intended already knows many synonyms for 
that word and can respond on that basis; therefore the 
test author Intended it to be answered by recall; l.e.. 
Knowledge. Other Judges might classify the item as 
Comprehension on the basis that t;he test author intended 
the synonym to be chosen on the basis of contextual clues 
in the reading passage. Many such differences in the 
frame of reference were uncoversd during discussion 
with Judges. The fundamental point is that the Judges 
differed in their assumption about the prior knowledge 
which a student brings to the test situation. In turn 
each assumed that the test author held his frame of reference 
and as a consequence Judges differed with regard to their 
opinions about the behaviors an item was intended to 
evoke. Concerted work with the Judges did not cause 
them to narrow the\r different conceptions of the prior 
knowledge which students bring to the test situationr 
Apparently, there is such a diversity in the educational 
experiences offered to students at the same grade level 
but who attend different schools that each Judge could 
argue with conviction about the tenability of his frame 
of reference on the basis of his direct experience from 
teaching in the public schools. 

It also became clear that their ratings differed 
because they believed some items could be answered 
correctly on the basis of processes which appear at 




«31fferent levels in the taxonomy. One kind of item required 
students to select the most appropriate title from a list 
of titles for a reading passage. One judge classified 
the item as Comprehension because he regarded the task 
as simply translating and reducing the reading passage 
into a title. Another judge classified the item as Analysis 
because he regarded the process as a line-by-line analysis 
of the passage to determine relationships among them that 
would serve as a basis for choosing a title. Disagreements 
on some other items could be attributed to one judge 
regarding the problem solving strategy as the manipulation 
of content in the passage to reach an answer and then to 
locate it in the list of alternatives, whereas another 
judge regarded the strategy as the systematic elimination 
of dlstractors from the list of alternatives. Paren- 
thetically, we subsequently presented the same item stem 
with and without alternatives to students who were asked 
to verbalize their solutions and did determine that the 
actual problem solving strategies did differ in many 
cases. 



In summary, judges exhibited less agreement in 
their ratings than vte had expected. Mar.y of these 
dissigreements were due to their different assumptions 
about the prior experience of students and about the 
problem solving strategies students would use. The intra- 
judgment agreement was greSvter than the inter- judge 
agreement which simultaneously suggests that the judges 
were consistent in their different assumptions and that, 
within a set of pre-conceptions on the part of the judge, 
the taxonomy provided a rather unambiguous guide for 
classifying the items. 



Arithmetic Computation test . Seven judges classified 
each of the forty-five items of the Arithmetic Computation 
test. Their modal ratings were; Knowledge, twenty-five 
items; Comprehension, four items; and Analysis, one item. 
Six Items received bimodal classifications: Knowledge- 

Application, four; Comprehension-Application, one; and 
Application-Synthesis , one. No item was rated identically 
by all seven judges and only each of six items received 
identical ratir.gs from six of the seven judges. 

Analyses of the ratings revealed considerable 
intra-judge consistency over similar kinds of items. 

Group discussion revealed again that differences among 
them was due mainly to the different assumptions about 
the relevant experience which students bring to the test 
situation. Generally, judges who had the most experience 
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teaching students of the age the test is intended 
were more likely to rate items at lower levels in 
the taxonomy than were judges who had less teaching 
experience. Other differences among Judges were noted 
but these reduce to imputed differences in problem 
solving strategies which were discussed in the preceding 
section. 



Analysis of Data from Tests 

The material presented in this section is based 
on three hundred students for whom reading, arithmetic, 
and scholastic ability scores were available. The 
students were ninth-graders in a single public school 
system. Three groups of 100 subjects each were selected 
on the basis of their scores on the Verbal Section of 
the School and College Ability Test so that the groups 
were statistically non- over lapping. The high group was 
selected randomly from students who scored more than 
one standard deviation above the mean; the average group 
was selected randomly from all students w5iO scored at 
or within one score point of the mean of the distribution; 
and the low group was selected randomly from all students 
who scored more than one standard deviation below the mean. 



Item data . On the Reading Test, eleven items were 
classified as Knowledge and the remaining items as 
Comprehension. 'T’he average difficulties on the Knowledge 
and ComprehensiOii items were »75 and .69, respectively. 
The average difference between the percentage of high 
and low ability groups passing an item was .27 on the 
Knowledge items and .42 on the Comprehension items. 

Item factor analyses based on exact tetrachoric 
coefficients were run for the three ability groups, 
separately. Eight zo ten factors emerged. At least 
one factor in each matrix might have been named 
"vocabulary” however, not all items which, on logical 
analysis, would be placed in such a factor actually 
loaded on it. The majority cf the other factors seemed 
to define the several reading passages which constituted 
the Reading Test. Attempts to sort each of the items 
into fliner subdivisions of each level of the taxonomy 
failed to create item groupings which corresponded to the 
factors which were obtained. 

On the Arithmetic Computation Test thirty-two 
items were classified, as Knowledge, .six items as 
Comprehension, five items as Application, and two items 
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as Analysis. The average item difficulties for these were 
•79, .72, .58 and .42, respectively. ' The average item 
differences between percentage of success of the low and 
high ability groups were: .20, .31, .48, and ,42, 

respectively. No item factor analyses were run on data 
from the Arithmetic Computation Test. 

Generally, the data from both tests lend support 
to the imputed hierarchical structure of the taxonomy. 

The item difficulties increased directly with the Increase 
in classification level of items. The data also supported 
our hypothesis that the spread between the success of the 
high and lov7 ability groups would increase as the classi- 
fication levels of items increased. Although the item 
factor data failed to reveal factors which could be called 
Knowledge and Comprehension but instead yielded a 
"vocabulary” factor and some rather poorly defined factors 
corresponding to the reading passages, we are disinclined 
to tadce the factor ainalyses seriously because of the large 
number of items on which there were extreme splits on 
pass and fail. 



P art-score data . After the test items in the Reading 
Test and the Arithmetic Computation Test had been classified 
separately, according to levels of the taxonomy, the 
answer sheets were scored to yield these taxonomy-type 
processes scores. The intercorrelation matrix of them 
appears in Table 1 and the factor matrix appears in 
Table 2. 



The rotated factor matrix reveals that Reading 
Knowledge and Reading Comprehension define one factor 
which might be called verbal ability. Arithmetic Knowledge 
and Arithmetic Application apparetitly define another. 
Theoretically, this grouping would not be expected; 
however, it might partially be explained by conflicting 
frames of references of the item classifiers. Since the 
Arithmetic Test did not Include a reading passage which 
explicated the principles which were to be applied during 
the test, then it follows that students had to apply 
principles they already knew. Consequently, judges' 
disap~*eed on whether such items should be regarded as 
Knowledge or Application. The factor on which Aritlimetic 
Analysis is highly loaded should, in our opinion, be 
igiiored because of the few number of items on which the 
Analysis score was based. 

The inference we drew from these studies was that 
if one wishes to investigate the validity of the taxonomy 
then he could not do so with data obtained from typical 
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TABLE 1 

Part -Score Correlation Matrix 





Tests 


12 3 


4 


5 


6 


1. 


Reading Knowledge 


.70 .53 


.49 


.45 


.33 


2. 


Reading Comprehension 


.54 


.60 


.56 


.41 


3. 


Arithmetic Knowledge 




.61 


.61 


.45 


4. 


Arithmetic Comprehension 






.56 


.46 


5. 


Arithmetic Application 








.56 


6« 


Arithmetic Analysis 











TABLE 2 

Oblique Rotation of Factor Analysis 
of Part Scores* 


Tests 


I 


II 


III 


IV 


1. Reading Knowledge 


.90 


.21 


.08 


.10 


2 . Reading Comprehension 


.79 


.18 


.19 


.31 


3. Arithmetic Knowledge 


.30 


.80 


.12 


.32 


4. Arithmetic Comprehension 


.30 


.28 


.19 


.85 


5. Arithmetic Application 


.27 


.70 


.47 


.12 


6. Arithmetic ihialysis 


.14 


.20 


.92 


.14 




•Unity was placed in cells of principal diagonal 
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standardized achievement tests. These tests did not give 
equal representation to all levels of the taxonomy. Further- 
more one could not assume with confidence that students 
brought the same content knowledge to the test situation. 

In shorty we concluded that it would be necessary to 
construct tests according to the Taxonomy in order to 
obtain the data we needed. The next section briefly 
describes our initial efforts in this activity. 



Construction of Taxonomy-Type Tests 

Several specifications were set for the taxonomy- 
type tests which were to be constructed: (a) each should 

be suitable for use with secondary school students; (b) 
each test should contain a reading passage which supplies 
the content on which the test Items are based; (c) items 
should be distributed approximately equally over the six 
major levels of the taxonomy; (d) all items should be the 
multiple-choice type; and (e) test administration time for 
each should not exceed forty minutes Including all pretest 
and posttest directions. 

Three reading passages were chosen on the bases 
of their probable interest value, appropriate reading 
level, and probable unfamiliarity to students. One dealt 
with the periodic table of elements; another with 
relationships among surface area, cross-section, and 
weight; and the third with the way of life in time past 
in Nay on, Equador. 

The project staff prepared test items according 
to taxonomy levels for each reading passage. Each item 
was criticized and dlscus>sel in staff meetings* Primary 
attention was devoted to classifying appropriately each 
item according to the taxonomy and editing it to make it 
technically good. 

A test booklet was thsn prepared consisting of 
directions, reading passage, iuid the test items in random 
order. Three such preliminary' versions were made and 
administered to eighty to l4o students. 

On the basis of observations of students during 
the preliminary testing and analyses of item data, cex^tain 
revisions of items, preparatior. of new items, rearrangements 
of the items in the booklet, ax:.d test administration 
procedures were executed. These are of inqportance and 
interest but the discussion of them is appropriately 
withheld until the next major section of the report which 
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deals with the construction of tests for the federally 
supported project. 

Considerable difficulty was encountered when 
revising the Nayon test. The content of the reading 
passage was not sufficiently dense to enable writing a 
large number of items about it, nor sufficiently complex 
to enable preparing items for the upper levels of the 
taxonomy. Nevertheless, it was revised and re-administered 
but student reactions to it during its administration and 
the results of the preliminary analyses of data from it 
which suggested low reliability, caused us to discard it 
entirely. Consequently, it is not mentioned hereafter. 

The fcllowing account is essentially the content of an 
article which was prepared by the writers (Stoker and 
Kropp, 195^1). 



The tests . The revised form of the test based on the 
periodic table of elements, hereafter referred to as 
AS (atomic structure) consisted of thirty-six multiple- 
choice items, six for each level of the taxonomy. The 
revised form of the test on relationships among surface 
area, cross-section, and weight, hereafter referred to 
as p, (right size), consisted of thirty-six multiple- 
choice items and three free response items; which were 
nearly equally divided among the six levels of the 
taxonoicy . 



Rater agreement on items . Five Judges independently 
classified the items of the AS test according to the major 
levels of the Taxonomy , and Tour different Judges 
similarly classified the items of the RS test. All 
Judges were doctoral students in educational measu 3 ?emsnt 
and were familiar with the Taxonomy . 

On the ^ test^ eleven of the thirty-si:: Items 
were unanimously classified congruent with the categories 
whose processes the items were Intended to evoke. On 
nine other items, only one Judge deviated from the other 
four. (Six of the nine disagreements were due to the 
same Judge.) On all but two of the remaining sixteen 
items, three of the five Judges rated each item in the 
category who«e process it was intended to evoke. 

The four Judges who classified the RS items 
agreed as follows: for eleven items their agreement was 

iL^anlmous 8U),d perfectly related to the categories the 
items were intended to evoke; for sixteen other items. 
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three of the four judges agreed with each other and the 
Intended category; and for the remaining items two of the 
four judges were in agreement. 



Empirical support of taxonomy . Since the taxonomy wais 
designed to be hierarchical and cumulative 5 the data should 
exhibit these characteristics: (a) the mean scores on the 

levels should decrease as the complexity of the leveD.s. 
increases; (b) the intercorrelation matrix of level scores 
should reveal simplical structure as described in the 
Quttman Radex Technique; and (c) factor amalyses should 
reveal a structure consisting of a unique factor loading 
only on the Evaluation subtests ^ a general factor, and four 
group factors which might be named Comprehension, 
Application, Analysis, s&id Synthesis. 

To gather data to test these hypotheses, the two 
experimental tests were administered to the student bodies 
0 .? two four-year high schools. Six hundred students were 
testt'd from one school and four hundred from the other. 



Hypothes i zed inverse re? .a tionship of level and mean score . 

To examine the hypothesis that mean difficulty increases 
as complexity of level increases, the ratios mean score 
to total Iteins was computed for each grade group on both 
the ^ and the RS tests. The ratios appesir in Table 3^ 

The ratios generally suppoz*t the existence of a 
hierarchical structure. Mean performance decreases as 
process complexity increat?es, thus Indicating support of 
the taxonomy and some construct validity of the exp€.^rlmental 
tests. The exception to these general statements is that 
the data for the AS test suggest pc.rhaps that the 
Evaluation level Ts misplaced in the taxonomy, or the 
items for it were poorly constructed o 

As a further investigation of this hypothesis 
a random sample of five hundred subjects was sorted Into 
six groups on the basis of total score on the combined 
Knowledge and Comprehension subtesbs of Then f‘or 
each group, mean scores were computed on the four remaining 
subtestSo The data appear in Table 4. 




The tabular data reveal (fi.) that as combined score 
on Knowledge and Comprehension imiroasee, then so does 
performance on the remaining subtests, and (b) that for any 
given level of combined score, the scores on the remaining 
svibtests decrease as the complexity Increases. However, 
this latter statement does not hold for the Evaluation 
subtest . 





TABLE 3 



Mean Performance on Experimental 
Tests by Process and by Grade* 





Grades—School 


A 


Grades— 


School 


B 




9 


10 


11 


12 


9 


10 


11 


12 


TEST OP ATOMIC 


















STRUCTURE 


















Knowledge 


.38 


.43 


.39 


.42 


.35 


.38 


.50 


.58 


Comprehension 


.36 


.37 


.33 


.37 


.32 


.30 


.38 


.48 


Application 


.38 


.40 


.41 


.43 


.35 


.34 


.46 


.44 


Analysis 


.3^ 


.38 


.33 


.40 


.34 


.33 


.42 


.49 


Synthesis 


.28 


.28 


.26 


.27 


.27 


.30 


.30 


.38 


Evaluation 


.38 


.45 


.40 


.47 


.37 


.41 


.45 


.51 


TEST ON RIGHT 


















SIZE 


















Knowledge 


.53 


.60 


.67 


.68 


.53 


.55 


.68 


.70 


Comprehension 


.52 


.58 


.60 


.57 


.48 


.58 


.61 


•68 


Application 


.24 


.28 


.31 


.32 


.25 


.30 


.36 


.32 


Analysis 


.30 


.33 


.34 


.38 


.31 


.34 


.38 


.38 


Synthesis 


.17 


.23 


.22 


.24 


.15 


.19 


.24 


.28 


Evaluation 


.19 


.21 


.25 


.22 


.19 


.22 


.24 


.24 



•Table values are equal to the mean score for the 
test divided by the number of items in the test. 
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TABLE 

Mean Scores for Higher Taxonomy Level? When 
Subjects are Grouped on Combined Knowledge 
and Comprehension Scores (Form AS) (N*500) 



Combined 
Score 
(Know. & 
Comp* ) 


Appli- 

cation 


Anal- 

ysis 


Syn- 

thesis 


Evalu- 

ation 


N 


11-12 


4*20 


4.00 


2,00 


3.40 


5 


9-10 


3.22 


3.39 


1.89 


3.61 


18 


7-8 


3.35 


2.89 


1.94 


3.13 


62 


5—6 


2*55 


2.07 


1.65 


2.68 


147 


3-4 


2.22 


1.78 


1.51 


2.28 


169 


0-2 


1.4? 


1.56 


1.58 


1.88 


99 


Presence 


of simplical structure 


. According to Guttman^s 


simplex theory, if a 


grrup of tests differ only in 





complexity, then this fact will be observable in a matrix 
of Intercorrelations amorg the tests o The hypothesis of 
hierarchical order for the taxonomy levels, then, lends 
Itself to examination by simplex analysis. The theoretical 
rationale for the simplex was presented in Section II in 
the context of hypotheses to be tested. 

Twenty correlation matrices, arising from the 
administration of the two experimental forms in both 
schools, were subjected to simplical analysis. None of 
the matrices satisfied the requirements of a perfect 
simplex. However, in approximately one^half of them, the 
Knowledge, Comprehension, Application and Analysis subtests 
were ordered correctly but the Evaluation mid/or Synthesis 
subteets were repeatedly out of order. 



Factor analyses . Very little evidence of the expected 
factor structure was found. For several matrices, the 
factors were identified as content factors; i.e., ^ 
and RS. When factor matrices for different grades were 
examine'^ two trends were noted: (a) Knowledge and 

Comprehension on the ^ test persistently loaded together 
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over grade levels, and (b) a definite increase in the 
size of factor loadings was observed as grade level 
Increased from 9 to 12. 



Summary . Generally the study might be summarized as 
follows. Inter judge agreement was found with respect 
to cognitive process being soui^ht in items. The d. a 
give general support to the hierarchical structure of 
the Taxo nomy . The data suggest a possible misplacement 
of Evaluation in the structure. Factor analyses failed 
to support the hypothesized structure of the Taxonomy . 



Critique 

The results of these early studies of the 
classification of items and the structure of the taxonomy 
weakly supported the validity of the taxonomy. As these 
studies progressed it became clear that those dealing 
with the agreement among raters’ classifications of items 
were interesting but not central; however, they did 
document the clarity with which the processes are 
described in the Taxonomy . The analyses of data from 
the commercially available tests yielded results which 
were somewhat helpful in illumining the taxonomy but 
their overall value was slight because the vast majority 
of items in the tests were at the lowest level and none 
of the upper level processes were assessed at all. At 
this point . it became evident that the most relevant 
data would be generated by specially prepared tests 
which would yield appraisals of student behavior at 
each of the six major levels of the taxonomy. To construct 
such tests was regarded as a task which would prove to 
be more time consuming than complex. Eight months of 
half-time work on the part of six to ten people in 
writing approximately 500 items and testing about 1,900 
students, coupled with about 30 hours of computer 
analyses of the resulting data produced the unimpressive 
results which were presented above. The task had been 
misjudged; it was time consuming and complex . 

The staff had specific misgivings about the 
tests and the data which came from them. The test 
content was entirely chemistry and physics; every 
attempt to build a test on social science content was 
abortive. There was a pronounced lack of confidence 
in all items which were prepared for Synthesis and 
Evaluation and there was a lesser, but significant 
feeling, that items for those levels could not be 
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written in the multiple-choice format. In fact, we departed 
from our specification and included free response items in 
the RS test. The subtest reliabilities were quite low 
probably due to the shortness of the subtests. It seemed 
that no more technically good items could be wrung from 
the reading passages. Furthermore, adding items would cause 
the overall testing time to become longer than the length 
of a public school classroom period. Traditional item 
analyses techniques seemed to te completely inappropriate 
for evaluating taxonomy-type test items. In short, there 
were serious reservations about the quality of what had 
been achieved. Nevertheless, the results gave slight . 
support and this caused the staff to prepare a proposal 
to be submitted to the U. S. Office of Education which 
would provide for a more extended and conqprehenslve study 
of the taxonomy. 



B. Studies Reported in the Literature 

Very few studies that deal directly with the 
Taxonomy appear in the literature. Those which could be 
located and which are directly relevant to the study are 
summarized here in three categories^ classification of 
items by Judges, statistical analyses of taxonomy-type 
data, and test banks. 



Classification of Items by Judges 

McGuire . A series of studies were undertaken at the 
University of Illinois College of Medicine in which the 
process approach to constructing and analyzing medical 
examinations were used. (McGuire, 1963). One of the 
early studies was to classify the items in the 196I 
National Board Examination which was issued by the National 
Board of Medical Examiners. Pour panels of three members 
each were formed to rate the items. Each panel represented 
a medical speciality and the three panel members were 
expert in that speciality. Each item was rated with 
reference to an eight-level adaptation of the Taxonomy. 

The levels were; recall, recognition of meaning, selection 
of relevant generalizations, simple interpretation of data, 
application of principles to situations of a familiar 
type, application of principles to situations of an 
unfamiliar type, evaluation of a total situation, and 
synthesis. Each panel rated only items in its speciality. 
Of the 683 items, each of 6l percent of them received 
identical ratings by the three Judges from the relevant 
panel. On each of 13 percent of the items, two of the 
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judges rated the item similarly but the third rated it 
either one level above or below their rating. Only on 
each of 7 percent of the items did all three judges 
disagree. More than half of these 7 percent of items 
were at the lowest three process levels of the taxonomy. 



Stanley and Bolton . Stanley and Bolton (1957) reported 
several related studies of the extent of agreement of 
item classifications which were made by their graduate 
students. They administered Terman’s Concept Mastery 
Test, Porm T, to 46 students in a beginning graduate 
course ’’Principles of Appraisal and Evaluation in Education.” 
The eight highest scoring students (101-135) were asked 
to classify independently the 227 items in Gerberich’s 
Specimen Objective Test Items ^ A Guide to Achievement 
Test Construction according to the six major levels and 
the twenty-three sublevels of the Taxonomy. Prior to 
this classification exercise, all class members had 
studied the Taxonomy for four weeks. The percentage of 
7, 6, 5, 4, 3, and 2 agreements on major level-and- 
sub level were 5» 13 » 17a 17 » 21, 19, and 8, respectively. 

One item was assigned to a different sublevel by all 
judges. The agreement among the eight judges was quite 
high when only the six major levels were taken into 
acco‘<mt. The raters classified the items as follows: 
Know3.edge, 51 percent;; Comprehension, 19 percent : 

Application, 8 percent; Analysis, 5 percent; Synthesis, 

.6 percent; and Evaluation, 4 percent. The raters 
judged that 12.5 percent of the items did not fall in 
the cognitive domain. 

Thirty -one items for which there was high 
agreement were cast into a test and thirty-six of 
the remaining class members were asked to rate each item 
according to major level and sublevel. Responses were 
scored as follows: two points for a major and sublevel 

agreement; one point for a major level agreement; and 
no points for an Incorrect major level. The resulting 
scores were correlated with the Concept Mastery Test 
scores. These coefficients were obtained: CMT 

S^e-Opposite, ,49; CMT Analogies, ,43; and CMT Total, 

»52, (The CMT subtests correlated at .72). 

In a further study, the eight original raters 
and the three students having the next highest CMT 
scores (91-98) were asked to classify specimen items 
from the Graduate Record Examinations. Forty-four 
items were used in the study and these were taken from 
two prospectuses of the ORE which were distributed 
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about 1954 by the Educational Testing Service. The major 
levels assigned to the achievement Items were: Knowledge, 

49 percent; Comprehension, 21 percent; Application, 4 percent 
Analysis, 17 percent; Synthesis, none; and Evaluation, 

9 percent. 



Summary . Both the McGuire and the Stanley and Bolton 
studies yielded results quite similar to those of our 
studies. Trained raters can classify test items into 
taxonomy categories with high agreement v/hen the basis of 
the classification is the behavior which the item is 
intended to evoke. However, neither of the studies nor 
ours deals with the relationship between the process the 
author intended to evvoke with the item and the process 
the item actually evokes from the student. 



Analyses of Taxonomy-type Data 

Anderson . Anderson (1964) constructed a taxonomy-type 
test and compared scores attained on the first four levels 
by students in CHEM studv and a traditional chemistry 
course. The taxonomy-type test consisted of six Knowledge 
items, nine Comprehension items, fifteen Application 
items and fifteen Analysis items. The test was administered 
as a pretest in October and as a posttest in the following 
April. The scores for all levels for both groups were 
significantly higher in April. No significant differences 
were found at any level between the two groups on the 
posttest. When subjects were grouped according to scores 
on the School and College Ability Test, the only significant 
difference was found with the Analysis items for low 
ability students. Factor analyses of the pretest and 
posttest scores revealed two major factors: Knowledge 

and Comprehension items defined one fact'^r and Application 
and Analysis items defined the other. 



Dunn and Turner . Dunn and Turner (1959) studied physics 
achievement in the Australian becondary school system 
using a modified version of the Taxonomy as a model for 
test construction. Three measures were obtained from a 
total of 1,526 students who were enrolled in physics. 
These measures were a premat riculat ion exai?ilnation, a 
matriculation examination, and teachers* estimates of the 
student’s ability in physics. The prematriculation 
examination was constructed according to a three-level 
modification of the Taxonomy . These levels were 
knowledge, application, and understanding. The knowledge 
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and application levels ap?r»oximately correspond to those 
same named levels of the Taxo nomy. The subtest of 
understanding encompassed th^r other four levels of the 
Taxonomy . The split-half reiiabilities of the 
prematriculation exajnination were .837 knowledge (51 
items), .828 applic^'tion (2H items), .888 understanging 
(55 items), and .933 total test (130 items). 

The bivai\iate distribution of the level scores 
were triangular indicating that high scores or lower 
level measures could be associated with either high or 
low scores on higher level sub-scores. However, a low 
score or the lower level would not be associated with a 
high score on higher level subtest. Correlation 
ooeftloS.^nts of .67 between knowledge and application, 

.66 between knowledge and understanding, and .71 between 
application and understanding were found for the three 
subtests. 

Correlation coefficients between the three major 
variables were estimated from the distribution of the 
rank order eorrveiat-*ons found within Individual classes 
in the sample. The average rank order correlations betvjeen 
each pair of the three variables were .68 between 
prematriculation and matriculation, .68 between prematric- 
ulation and teachers* ranking, and ,70 between matriculation 
and teachers* ranking. 



?jgg^ _and ^ C hambers . McFall and Chambers (no date) 
constructed an achievement test, composed of two subtests, 
on the relationship between plants and animals. One 
subtest contained recall (Knowledge) items and the other 
contained problem solving items (higher level cognitive 
processes). The test was administered to il57 students 
in seventeen general science classes from grades seven 
to eleven. The test scores were correlated with first 
semester science grades, total scores on the Stanford 
Achievement Test, and scores on the Science section of 
tjh6 Stanrord Achi6V6iR6nt Tast# The invesliigators 
hypothesized that the recall items would correlate more 
highly wltli achievement measures than would the problem 
solving items . They found highsjr relationships between 
the recall subtest and criterion measures (Stanford 
Achievement Stanford Science, .45s snd science 
grade, .41) than between the problem solving subtest 
criteria— .54, .39, and .19, respectively. 

The differences between each of the three pairs of 
corTelatlons , e«g., recall and science grade, and problem 
solving and science grade, was statistically significant. 




McGuire « The eight«=*levels taxonomy which was constructed 
by the College of Medicine of the University of Illinois 
was subsequently reduced to six major levels and was 
named the Taxonomy of Intellectual Processes (McGuire, 

1963). The six levels are described as follows; Level 1, 
recall and recognition of meaning; Level 2, generalization; 
Level problem-solving of a familiar type whi3h includes 
(3.1) simple interpretation of data and (3* 2) application 
5f a standard combination of principles; Level 4, 
problem-solving of an unfamiliar type which includes (4.1) 
analyses of data and (4.2) application of a unique 
combination of principles; Level 5 evaluation; and 
Level 6 synthesis. 

This taxonomy was used as a framework within which 
to construct comprehensive examinations. Analyses of the 
results of those examinations supported the Imputed 
hiervarchical and cumulative characteristic of that taxonomy. 
The hierarchical nature is supported by the intercorrelations 
between scores from the six levels. There is a tendency 
for the adjacent levels, to be more highly correlated than 
widely separated levels. The correlation and factor 
matrices appear in Tables 5 and 6. 



Smith . Smith (1965) investigated the scalability of the 
Knowledge and Comprehension levels of the Taxonomy . A 
fifty-five item, four-choice multiple-choice test was 
constructed on five educational psychology concepts. One 
item was prepared for each concept for each of eight 
Knowledge sublevels and t\e three Comprehension sublevels. 
The test was administered to 341 educational psychology 
students who had been introduced to the content through 
lecture of textbook. Because it is claimed that the 
Taxonomy is arranged from simple to complex and from 
concrete to abstract, item difficulties should increase 
as Taxonomy level increases. Smith also claimed that 
this relationship should hold for the sublevels of any 
meijor Taxonomy level. He found a rank order correlation 
of .76 between the actual ranking of sublevel difficulties 
and the theoretical rankings. It indicates a general 
increase in item difficulty as level increases within 
Knowledge and Comprehension. The intercorrelation matrix 
of Knowledge and Comprehension sublevel scores failed to 
form a simplex. Thus the hypothesis of a hierarchical 
structure of the sublevels of the first two levels was 
not supported. The inter-item correlations in the three 
sublevels of Comprehension across the five educational 
psychology concepts utilized were positive, but no larger 
than might be expected by chance. Thus, it would appear 
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.057 


.139 


Level 2,0 


Generaliaation 
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.006 
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.527 


Level 3.1 
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.197 
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.356 


.591 


Level 3.2 


App. of Fam. Prii.. 


.133 
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Analysis 
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^Valuation 
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Level 6,0 


Synthesis 


.101 


.950 


.055 


.117 


.037 




"Level 1.0: Recall has 


a higher loading on Fact 


or 1,. and 


only on 





Factor 1; in addition this came factor makes a substantial contri- 
bution to scores at the neighboring levels 2 (Generalisation) and 
3.1 (Interpretation of Data^, and makes virtually no contribution to 
scores at Level 3.2 (Application of Familiar ?rir:ciples) and above. 
Other groups of variables ;^hicL ;.ave significeat loadings on a coi.u.ioa 
factor are: 



variables 



Loaaiitgs 



Factor 



Level 6 and Level li.l 
Level 1,2 and Level 2.0 
Level 3.1, 3.2 and i,.l 



,9^ and ,li'J 
,55 and' ,6k 
.59,. 55, .61 



on Factor 2 
on Factor 5 
on Factor 5 



Level 5: Evaluation stands alone as the only variable with a high 
loading on Factor 3 and it loads significantly only on that factor. 
These groupings are compatible with the logical structiu’e of the 
Taxonotty (of IntolJ actual Processes)." 
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that the processes measured by the items of sublevels are 
not general over content. 



Thomas. Thomas (1965) studied the three lower levels of 
the Taxonomy . Her major purposes were to test the 
cumulative hypothesis of the Taxonomy ; to detemdne the 
relationship between taxonomy-type test performance and 
intelligence, and reasoning ability; ?md to determine if 
students whose scores were not consistent with the 
cumulative hypothesis differ in intelligence and reasoning 
ability from students whose scores are consistent. Data 
concerning achievement on a taxonomy-type test were 
gathered utilizing specially constructed tests. Intelligence 
scores were obtained from the California Test of Mental 
Maturity and reasoning ability was measured by the 
Cornell Conditional-Reasoning and Class-Reasoning Tests. 

The subjects consisted of four sections of seventh grade 
science students in an urban Junior high school. The 
taxonomy-type tests were developed with one item at each 
of the three levels for each of eleven generalizations 
about heat and light. To assure control of content, the 
experimenter taught each of the sections a on€i week unit 
on heat and a one week unit on light. The eleven 
generalizations were presented and the class discussion 
was controlled so that the novelty of the higher level 
items would be preserved. The last day of each week was 
devoted to testing for the generalizations presented and 
for gathering the reasoning ability measures. 

Guttmsn’s simplex analysis was used to test the 
cumulativeness of the levels. The correlation matrices 
of the three levels showed the general pattern of a 
simplex. The correlations between level scores and CTMM 

higher for Knowledge (.^1) than for Comprehension 
(•33/ snd Application (.32). The opposite was found 
between level scores and reasoning test scores with the 
correlations being Knowledge. 46, Comprehension .55, and 
Application •o2. No slgnlflcsnt dlTferonccs wor© found 
between the mean CTMM scores for subjects whose level 
scores were consistent with the cumulative hypothesis and 
those whose level scores were inconsistent. 



SunmiarjL* The studies reported in this sub-section give 
general, but not unanimous, support to the cumulatively 
hierarchical structure of the Taxonomy . The most 
ambitious of these studies was conducted by McGuire and 
it focused on an abridgement of the Taxonomy. The most 
apparent difference between her taxonomy and the parent 
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one is the reversal of the Synthesis and Evaluation 
levels. Consequently, the empirical support she found 
for her taxonomy partially discredits the parent taxonomy. 

The Smith study is the only one which dealt directly with 
sublevels of the Taxonomy . His results do not support 
the hierarchical structure of sublevels but the results 
of additional and more complex studies are needed before 
a definitive judgment can be made. The Thomas study 
suggests that correlations between taxonomy-level scores 
and group intelligence scores decrease as the level increases 
and that correlations between taxonomy-level scores and 
reasoning ability scores increase as level Increases. 

Similar relationships were found by the writers in their 
preliminary studies. 



Test Bank 

The San Diego County Secondary Curriculum Council 
(Kellogg, 1964) developed an American History Test Bank 
as a part of an in-service training program. The test 
bank consists of items which were developed by secondary 
school teacher-' of American History and includes items 
fx*om eight areas of American History* The items were 
constructed according to the Taxonomy . Inspection of the 
items in the Test Bank reveals that the higher the 
Taxonomy level the higher the proportion of free response 
items. The Synthesis and Evaluation levelrs are 
exclusively free response. The Test Bank provides a 
pool of items from which classroom examinations could 
be constructed. 

This report about the data bank and the Stanley 
and Bolton study which was presented earlier suggest 
that the vast iaajority of test items in the cognitive 
domain are intended, wittingly or unwittingly, to 
assess the processes appeeiring at the lowest levels 
of the Taxonomy . The writers’ analysis of items from 
standardized achievement tests corroborates t’ is 
observation. 



NOTE 

Subsequent to preparing this section of the report, 
, Dr. John M. Gordon, University of Hawaii, and Dr. Richard 

C. Cox, University of Pittsburgh, jointly distributed /an 
annotated bibliography of all published research on the 
Taxonoms^ and an annotated list of all Taxonomy research 
projects known to be currently undei»way. Copies mlghtt be 
^ obtained from Dr. Cox. 
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III . TEST DEVELOPMENT 



A. Rationale 

It was apparent that to determine the validity of 
the taxonomy, the generality of processes over content and 
the psychological structure of the processes, it would be 
necessary to construct tests specifically for these purposes <> 
Analyses of currently available achievement tests revealed 
that not all of the taxonomy levels were represented and the 
majority of items appeared to be at the lower three levels. 

It was also clear that the appraisal of the processes 
could be done only if the students had substantial and rela- 
tively equal mastery of the content on which the items were 
based. If they possessed this mastery of content, then a 
greater proportion of variability of scores could be ascribed 
to their differential command of the processes. Thus a 
question arose as to the manner in which equal content mastex*y 
might be achieved. Three possibilities were considered. 

First, to select a content x^hich obviously had been already 
overlearned by the students. Second, to instruct subjects in 
a content until they reached a predetermined level of mastery 
prior to administering taxonomy-type tests. Third, to select 
an unfamiliar content which appeared to be within their power 
of mastery, to expose them to it at the beginning of the test, 
and to permit them to refer to it during the entire testing 
session. 



The selection of a response measure also posed a 
problem. The alternatives were to have students verbalize 
their solutions to the items, to record theip, then to analyze 
them for the presence or absence of the process in question; 
or to collect their forced-choice or free-responses to items, 
to score them right or wrong on the basis of a logical key, 
and then to infer that the desired process was used if the 
student responded correctly, but not otherwise. 

Because one purpose of the study was to determine the 
generality of processes, it would be necessary to select 
several contents on which to build the tests. 

The decisions which were made about these and oi;her 
problems are presented subsequently. 



B. Test Specifications 

The specifications on which the preliminary taxonomy- 
type tests were constructed were presented in the preceding 




sections as; the tests should be suitable for use with secondary 
school students, should contain a reading passage which supplies 
the content on which the- -test items are based, items should 
be distributed approximately equally over the six major levels, 
items should be multiple-choice, and test administration time 
for each test should not exceed forty minutes including all 
pretest and posttest directions. 

The preliminary forms of the tests were constructed 
roughly to those specifications. Observations of students 
during the time they were taking these tests, comments which 
they made about them, and results of analyses of data from 
the tests caused some of these specifications to be modified 
and others to be introduced. 

As part of the Office of Education supported study, 
additional tests were constructed on the basis of these mod- 
ified and expanded sets of modifications. Pilot try-outs of 
them resulted, again, in showing the need to silter the speci- 
fications. Rather than to present each s' jcessive set of them, 
the final set is presvented here and a discussion accompanies 
each about the need for the specification and its evolution, 
if appropriate. 



Intended Audience 

The decision that the test should be designed for use 
with secondary scnool students, grades nine through twelve 
inclusive, was made at the outset and held throughout. Data 
from preliminary and final forms of the test reveal that 
ninth-grade students find the tests to be quite difficult. 
Preparing a set of items which would assure some success for 
them and simultaneously provide celling for the twelfth-grade 
students proved to be a difficult task. 



Content 

To appraise processes it would be necessary to base 
items on a content on which students had relatively the same 
mastery so that variability in scores would reflect difference 
in level of mastery of the processes. Of the three methods 
which were considered for doing this — select a previously 
overlearned content, teach the content to a given level of 
masterly prior to administering the test, and to provide content 
with the test— we chose to provide content with the test. We 
could nji identify a content which had been overlearned by all 
prospective testees which also would be sufficiently complex 
to enable preparing items for the upper levels of the taxonomy. 
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We discarded the possibl3,lty of training students to a given 
level of mastery in a content prior to the test primarily 
because it would have been too time consuming. Data were 
needed from several thousand students so the estimated time 
that would be needed to train them in groups of thirty made 
this possibility completely untenable. However, we continue 
to believe that doing so will yield the most valid data if 
costs in time and money are unimportant. 

The content would have to be relatively short, within 
the reading abJ.iity of students, within the mastery of students, 
of sufficient internal complexity to enable writing items at 
all levels, and equally unfamiliar to all students at the 
outset. Particular problems which were encountered in selecting 
and abridging such passages are described in later sections. 

The relevant content was presented as a reading 
passage at the front of each test booklet and students were 
directed to read it before attempting to answer the items and 
they were free to refer to it anytime during the test. Their 
rather disappointing test performance caused us to abandon 
the random order in which items were presented. All Knowledge 
items were presented initially and they were ordered according 
to the appearance of answers in the reading passage with the 
consequence that responding to the intial set of items caused 
the student to read through the initial passage again. 



Distribution of Items over Levels 

The specification that the number of items should be 
constant over six levels was met in many of the preliminary 
forms but was ultimately abridged. Each of the final forms 
contains twenty items for each of Knowledge, Comprehension, 
Application and Analysis, five items for Synthesis, and ten 
items for Evaluation. The scoring scheme provides the saune 
maximum score for all levels. The departure from having equal 
numbers of items at all levels was prompted by our becoming 
convinced that Synthesis and Evaluation items could not be 
written in the multiple-choice format, which was also a 
specification. Quite abruptly we discarded that format for 
those levels and substituted free-response items. 



Item Format 

As stated above, this specification was altered. The 
first four levels of the taxonomy are assessed by multiple- 
choice items, and the upper two levels by free-response items. 




Administration Time 



The initial specification was that an entire test, 
including all preliminary and final directions, should be 
administered within a class period. This requirement was 
held through many of the preliminary versions but was finally 
abandoned as being unrealistic. Working within the confines 
of a, single class period and the restriction that equal num- 
bers of items appear at each level, resulted in producing a 
test which contained only six items per level. The brevity 
of such subtests resulted in unacceptably low reliabilities. 

It should be noted in this context that as the complexity of 
an item increases, the solution tjjiie does too. The amount of 
time which students spent on Analysis, Synthesis, and Evaluation 
items was substantially greater than our expectation. Conse- 

items were added and time limits were lengthened, 
forms are designed to be administered in two sittings 
of fifty to sixty minutes each. The first sitting includes . 
the items for the first four levels and the second sitting 
conslSi/S of the Synthesis and Evaluation items. The parts 
must be administered in that order. 



Test Forms 

Our Initial specification was to build several forms 
each based on a different content. This specification was 
held throughout but more in spirit than in fact. The initial 
decision was to build two tests ^ one besed on science content 
and the other on social science content, and an equivalent 
form for each. Quite quickly it became clear that equivalent 
forms could not be developed so four forms were constructed, 
two on science content and two on social science content. The 
extent to which each is equivalent to the other three is 
essentia.lly a restatement of the question of whether the 

processes transcend content and it is dealt with in the section 
on results. 



C. Selection of Passages 

The content for the tests was to be supplied in a 
reading passage which would precede the items in the test 
booklet. The following requirements were established for the 
passage; 600-900 words in length, probable high interest value 
to ssoond&ry school students^ social science end science 
content, within the reading ability of secondary school -stu- 
dents— actually the dlfiiculty level was set to be abbut the 
ninth— grade level— and the content for the passages should 

be selected from published materials rather than to be written 
by the staff. 
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Generally the following kinds of publications were 
searched for passages; professional journals, publications 
which carried popularisations of science and social science 
articles, and books which consisted of extended accounts of 
science or social science topics which were presented in 
layman *s language. 

Articles were gathered which dealt with the following 
topics; science of soap bubbles; evolution of a river; evo- 
lution of a star; Islam religion; interrelationships of 
surface area, cross-section, and weight; life in a primitive 
village; stages of economic growth; atomic structure, the 
effect of an earthquake on a country; the nature of glaciers; 
and relationships between architecture and climate. 

The reader should, note that the selection of these 
articles and the eventual discarding of some of them were not 
executed in the orderly fashion implied by this account. 

First, the project staff divided into teams to select articles, 
to present them to the entire staff for their approval, and 
then to prepare items based on the passage. Seco?.id, the 
activities among subgroups were carried out in the same 
sequence but the stage of development was not coordinated 
over the groups. Furthermore, discarding tentatively selected 
passages occurred at nearly every stage of the process ranging 
from the time the passage was presented to the group for the 
first time to a point after which the resulting test had been 
administered in two preliminary versions to at least five 
hundred or more students. The balance of this topic is de- 
voted to difficulties which the staff encountered with the 
passages, student reactions to the passages, abridgements of 
the passages, and particular reasons for discarding some of 
them. 



Some articles had to be discarded because they simply 
did not contain enough complex materials or enough principles 
to permit writing a large number of items about them. If 
articles did not contain stated principles, scientific laws, 
or generalizations then the articles were eventually dis- 
carded because it became extremely difficult to write anything 
but Knowledge and Comprehension items about them. This 
realization came quite late during the initial period of tert 
construction. Sometimes hundreds of hours v?ere invested in 
preparing test items before it became clear that the intel- 
lectual ceiling of the passages was too low. 

One passage was carried through two preliminary test 
administrations before It was abandoned. Although the passage 
seemed to fit exactly our needs, we later learned from student 
comments and item analyses of their :^esponses that the passage 




was probably too complex for them to grasp in the short time 
that was allowed at the beginning of the tests. Between 
administering th^ first and second versions of it, the passage 
was made more redundant but the resulting passage was too long 
to be suitable. 

Another passage was carried through two field try-outs 
but was abandoned because it apparently bored students to the 
point where they did not want to work with it. This reaction 
was noted more frequently with social science materials than 
science materials. 

Still another passage had to be abandoned because, at 
the time the preliminary version was nearing completion, new 
instructional materials were introduced in the schools which 
virtually overlapped the test content. Although we believed 
the test would serve our purpose, we discarded it because the 
content would soon be relatively familiar to all secondary 
school students and as a consequence the test would be virtu- 
ally useless to anyone who wished to use it in the future. 

The four passages which were finally adopted dealt 
with the Lisbon earthquake, evolution of glaciers, a theo- 
retical account of stages of economic development, and atomic 
structure. Only one of these, atomic structure, was a passage 
which the staff had worked with from the time the original 
study began. 

The four passages were used in their original forms 
at the outset but experience with them through item writing 
and analysis of student responses showed that each had to be 
altered in some manner. It was necessary to introduce addi- 
tional content into each to enable writing Analysis, Synthesis, 
and Evaluation items which were acceptable to us. The passage 
about the Lisbon earthquake had to be shored up by weaving in 
various philosophical theories about why earthquakes occurred. 
The passages on glaciers was supplemented with several tables 
and Illustrations which we found to be a most useful technique 
for introducing a considerable amount of content without taking 
an inordinate amount of reading time from students. The 
passage on atomic structure was expanded to include a Twentieth 
Century counterpart of Mendeleef »s original table. 

The four test booklets which contain these reading 
passages appear in Appendices A through D, Inclusive. 



D. Preparation and Classification of Items 

The project staff divided into teams each of which 
was responsible for preparing and classifying items for a 
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^ reading passage. Each team consisted of a content specialist 

? who had had experience teaching public school students in the 

! general content areaj. a measurement specialist 5 and usually 

t a person who combined both the experience and training. 

r ' 

, The initial requirement laid on these teams was to 

I prepare a certain number of each items at each level of 

\ taxonomy. The teams were most likely to prepare items at 

the lowest levels first, then to move into the higher levels 
; only to find that the reading passage was too lean Tor them 

to do 30 . The requirement was then changed to preparing items 
' on a round-robin basis; i.e., to write an item for each level 

' <md then to repeat the cycle. This procedure proved to be 

much more economical because deficient passages were identified 
i much quicker. 

These writing experiences led to the observation that 
the analysis of passages for adequacy and the facilitation of 
item writing would be considerably enlianced if at the outset 
the reading passage was analyzed for its internal theoretical 
and logical structure. Such an outline of the structure of 
the passage was useful in inferring whether upper-level items 
could be written and subsequently, it proved to be valuable 
in determining how to augment the passages with additional 
content. With the outline, it was relatively easy to determine 
the chauracteristics which supplementary material should have 
in order to increase the complexity of the passage, broaden 
the knowledge basis of It, etc. Augmenting passages without 
regard to having a clear notion of the internal structure 
often resulted in merely adding a layer of content which 
extended the breadth of the passage but rarely extended its 
depth. 

Each writing team presented on a regular basis its 
items to the entire group for review and criticism. Prior to 
the group meetings all members received a copy of the reading 
passage and a list of items. Each item carried a code con- 
taining the classification of the item according to the 
taxonomy and the name of the item writer. Each item was 
consid05?ed individually at the group session. The general 
sequence of consideration was as follows. 

I First, the participants, except for those who prepared 

the item, attempted to establish the level of the taxonomy 
which the item was intended to represent. No attention was 
given at this time to classifying an item more precise.Iy than 
by major levels. However, item writers deliberately attempted 
to sample each of the subdivisions within each level. 

Second, when a difference between the writer *s Intended 
classification and the grotxp's classification occurred, it was 
o 
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reconciled whenever possible. When an agreement could not be 
reached the item was discarded. Principal sources of difficulty 
were Synthesi'^ ,and Evaluation items and any other items for 
which responses might have been learned by students prior to 
their exposure to the test. Differences among the project 
staff about Evaluation and Synthesis items were difficult to 
reconcile during the time when all items were written in the 
multiple-choice format. These disagreements almost entirely 
disappeared when the free-response format was adopted. When 
disagreements arose which were basically differences in attri- 
butions about the experiential background which a student would 
bring to the test, the disagreement was hard to resolve except 
arbitrarily. Prolonged and fruitless debate caused us to 
9dopt a resolving principle; the group would bow to the Judg- 
ment of the staff member who had previously taught in that 
content area at the secondary school level. 

Third, after a classification of the item had been 
agreed on, the group criticized the item. The stem and . 
alternatives were conslderved in turn. If only editorial 
changes were made, then. the item was accepted for use. If 
changes in the substeuice of the stem or alt ernatlves were 
made, then the group recvOn?idered the classification of the 
item. Oftentimes seemingly slight . changes in the item caused 
a change in its level. This general working scheme was 
followed weekly in group meetings until all items for a trial 
form of a test had been accepted. 

.As stated earlier all participants had difficulty 
writing and classifying Evaluation ^and Synthesis items, during 
the time the multiple-choice format was in effect. The 
Synthesis process essentially involves the re-combination of 
elements into a new structure which provides a unique commu- 
nication. Our attempts to cast this process into the 
forced-choice format generally led to items for which the 
alternatives were such recomblnatlona and the .sought for 
response was the identification of the one which appeared 
best or the one which could have been created solely on the 
information which appeared in the passage. Typically these 
items were classified as Analysis, but sometimes as Evaluation. 
The Analysis classification was. Justified on the basis that 
the principles in reading passage had to be identified and 
then the alternatives to the items had to be analyzed to 
determine which of them contained, these principles but in a 
new form. The Evaluation classification was sometimes given 
on the basis that the best one of the alternatives could be 
selected only on the basis of Invoking some external or interna!, 
set of criteria by which to Judge the relative goodness of 
each of them. 
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The multiple-choice items which were Intended to 
asse:is Evaluation were most frequently rated as Analysis. 

Usually the items contained alternatives which embodied the 
product of the Evaluation process and the student was requested 
to choose the best, one of them. Therefore the raters regarded 
the required process as Analysis because. the criteria for 
judgment were generally Included in the stem; consequently, 
there was no need for the student to furnish the criteria 
which seems to be an essential part of Evaluation. Another 
difficulty which we encountered with Evaluation items was 
our failure to realize that by-and-large the criteria for 
Evaluation must bt supplied from a source other than the reading 
passage; e.g., evaluation according to an external set of stand- 
ards. We seemed to Ignore this, probably because we believed 
that the passage should contain all relevant information except 
for the process itself. 

For an extended period the project staff developed 
ad hoc principles for determining when an item should be 
classified as Evaluation or Synthesis. Each principle generally, 
had a life dating from the time the agreement was reached until 
the next time it was considered. It is for these reasons that 
the forced-choice format was abandoned for these levels# This 
decision came quite late and as a result the Evaluation and 
Synthesis items which appear in the four test booklets are 
undouboedly not as good as they should be nor as good as they 
could have been had more time been available for trying 
different techniques of writing such items. 



E. Administration of ^Preliminary Forms 

The discussion of the administration of preliminary 

test forms is limited to the four forms which were finally 
adopted. 



Eacn form was administered at least three times to 
poups of secondary school students. In every administration, 
tenth- and eleventh-grade students were tested, but in about 
oi^y half of the administrations were ninth- and twelfth-grade 
students Included. This limitation was due partly to our 

that we could obtain the needed data from the mid-groups, 
the fact that it was difficult to obtain twelfth'=-grade students 
because school officials felt that too much of their time had 
been devoted already to a required state testing program and 
several national and special testing programs, and the fact 
that it was awkward to obtain many ninth-graders because that 
grade level is in neighborhood and feeder schools which are 
generally small. 
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All teats were administered by the project staff. 
members were used for a thirty-student group and one additional 
staff member was used for each ‘ additional thirty students. 

Local teachers and guidance counselors were sometimes used aff 
proctors, but only when there was a forewarning that their 
presence might be useful in preserving the order of the group. 

During each administration, observational records were 
kept by proctors and, in the majority of instances, students 
were asked to provide feedback after the tests had been 
administered. 

The proctors entered in their records all student 
questions about test directions, reading passage, and test 
items. The questions about items were identified according 
to the intended level of the item. The frequency of questions 
was positively related to the level of the item. Proctors 
noted the time during the test when student inattention seemed 
to occur. One proctor usually collected information about 
the apparent Incidence with which students referred to the 
reading passage during the test. When possible, the time was 
noted at which some students apparently quit the test., i.e. , 
the time at which they "gave up" prior to expiration of the 
time limit. The proportion who finished within the time limit 
was also noted. 

Students were asked to supply information either by 
ci'^ecklng items on a questionnaire, giving oral responses in 
a g:;'oup session, or writing responses to relatively unstructured 
questions about the following topics; whether they had pre- 
viously encountered the content of the reading passage, whether 
the reading passage seemed to be too difficult for them, whether 
the technical vocabulary in the reading passage handicapped 
their reading and responding, whether the items seemed to be 
too difficult, and whether they believed that previous course- 
work in the general area of the content would have made the 
test less difficult and increased their scores, and the ways 
in which thvsy believed the tost differed from those they had 
taken in the past. 

The manner in which these two sets of information and 
their test responses were used in the revision of tests is 
described inithe next section. 



?. Analysis of Preliminary Forms 

The two majvor sources of lm?0!?mation used in the 
. revision of test forms were (a) observations of students and 
thelr^ nractioxw to the testa, and (b) statistical analyses 
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tests. To a minor extent infannatlon 
gained through recordings of student oral problem solving proc- 
esses were used but this lnfo 3 ?matlon proved not to be very 
helpful. Although decisions to revise the tests were usually 
based on infoimatlon from both sources, each is presented 

enables identifying more pointedly some 
problems which arise when constructing taxonoray-type. tests. 



Proctor Observations and Student Reactions 

Many changes in the test directions were made because 
observations and stvient reactions. :the directions 
were altered to emphasize that students could refer to the 
passage anytime during the test administration. In some 
versions this instruction was written on to each page of the 
test booklet. Even when students were so lnstruc,ted they 

apparently wondering whether it was fair or 

if one was permitted to 

look up the answers. 

altered to inform students 

pointedly that, although they could refer to the passage and 
find some of the answers, the answers to some of the items 

careful consideration of the content 

The need ^5®®® appeared in the passage. 

4-vJf direcuion came from student reactions that 

the passages were incomplete because some of the answers d^d 

proctors who observed students'" 
searching endlessly for specific answers which were not there. 

free-response Evaluation and 
several revisions to emphasize 
unmistakably that answers did not appear in the nassave 

equally correct answers might be 
Giving divergent responses to items was 

when asLd^?do to.*° and they were uncomfortable 



14. directions were altered to advise students 
simultaneous.Ly that all answers did not appear in reading 

should not :’>pend an undue amount of 
time on any .item. Proctors observed that Synthesis and 

eration^from*student^ received inordinately extended consid- 
in? also believed that students 

did not attend to the tables, charts, etc., which were in 

re^ndlri"?hl?‘ iSai? 1 ?? directions we^e written to contain 
reminaers ^hat Important information appeared in them. 

The reading passages were altered on the basis of 
student reactions. Chiefly, these changes involved dllSwng 
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the technical tei'minology, creating more but shorter 
paragraphs and sometimes increasing the readability of 
sections, and, in one instance, preparing and adding a 
table so that the content might be more readily understood. 

In addition to the difficulties which project 
staff had in preparing and classifying Evaluation smd 
Synthesis items, students were perplexed by them, spent 
an inordinate astount of tinie on each of them, and proctors 
were more frequently questioned about them than about any 
other level of item. These factors, along with statistical 
data which are presented subsequently, causect the staff to 
abandon the specifications that the multiple-choice foxr^at 
be used for Evaluation and Synthesis arid that the total 
test be brief enough to be administered in one class period. 

Also, student reactions of disinterest to one 
passage caused us to abandon it although it was otherwise 
well-suited to the purpose and the item analysis data were 
satisfactory. 



Statistical Data 

After each preliminary version was administered 
certain routine ststlstleal analyses and descriptions 
were prepared for use in revising the form. These included; 
frequency of response to all alternatives and skips and 
omits for each item; subtest means and standard deviations; 
iuid item-subtest correlations. ^Phese were used as follows 
Items^ which had extremely low or negative correlations with 
overall subtest scores were re-written or discarded; 
alternatives v?hlch received no responses were either 
discarded or re-written to be more plausible; and items 
for which distractors received a higher response than did 
the responses were cheeked carefully, along with the 
reading passage, to be certain they were not technically 
inadequate . 

The reader will surely be aware that some standard 
methods of item analysis and item selection were not 
mentioned in the above description although) the necessary 
data were available. The staff attempted to confine its 
revisions to those items which were obviously bad by ai>y 
standard and to be certain that other items were free cf 
defects which could be altered by simply editing them. 

The reasons for th5.s are presented in the next section. 
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0. Problems In the Analysis of Item Data 

A ma,1or problem confronted the staff when item 
analysis data from the preliminary forms were to be 
evaluated. The problem was fundamentally theoretical 
and methoaoiogical, and it had distinct ethical overtones. 
The latter is treated first, then the former. 

^ 4 * 4 .V .P® ethical problem was simply this: possession 

01 the item analysis data provided the staff with 

which bore directly, through a chain of fixed 
rtctiviiciesj. on the ultimate outcome of testing the 
hypothesis about the structure of the taxonomy. How the 
analyses were used could finally shape the result of 
testing uhe hypothesis. An example will clarify this 
matter. It is claimed that the taxonomy is hierarchical; 

Investigators arranged several tests 
nn one of which was that mean difficulty 

increase as the level of the subtest 
structure. Thus, item analysis data 
opportunity to select items which would 
determine whether the hypothesis would eventually be 

extricated itself by 
making certain kinds of decisions which 
construction. For example, 
inclusion in the suhtests 

ef desirable range 

deviations, or mean 

^?®nerally test constructers are urged to 
achieve^ a .50 difficulty level in each subtest so that 
the maxj.mum number of discriminations will be made by 

in suggestion would have resulted 

hypothesis SoS thf 

Of the taxonomy would have been 
re^v^cted. adopted this working principle: jf an 

item correlated positively with its^ubtest score Sd if 

fr"" deficiencies, then it wS 

Ancludec. in the test; however, it znlght have been 
discarded randomly later in order to have the same 

f^^ievels!^"^^ su?Jtests for the first 



The theoretical and methodological problems w^re 
numes-o^ and, unfortunately, most of them remain Sr«iolved 
Our^only contribution in this regard is that wf i^utef 



First, we did not 
on which Knowledge items 



knovt hon to regard answer sheets 
were answered incorrectly or 






mcitm 









omitted. If the relevant Information appeared in the 
passage and if the Knowledge item was answered incorrectly, 
then numerous questions arose. (Of course, we are 
omitting from this discussion the fact that students 
could have overlooked items, entered the wrong response 
through carelessness, etc.) Two of the prominent ones 
are: (a) was the stimulus value of the item eo ?.ow that 

the student did not recognize that the bit of knowledge 
which he stored was relevant for responding to this item? 
and (b) would the student’s answer sheet have any value 
whatsoever on account of this Incorrect or omitted response. 
With regard to the former, we simply assumed that the 
faulty or absent response was due to our failure to write 
an item of high stimulus value* l.e., we assumed the 
fault was in the item and rejected the possibility that 
the student did not possess the relevant content. So we 
altered the item in a way that we hoped would make the 
correct response more obvious than it was. That we were 
not firm in our assumptions is borne out by two other 
steps we took. We lowered the reading difficulty of the 
passages to maximize the student’s chance of storing the 
information in the first place . We placed all Knowledge . 
items at the beginriing of the tests and ordered them 
according to their order of appearance in the passage. 

The second question— could we use the student’s answer 
sheet if he missed a Knowledge item — was one that we 
resolved arbitrarily by stating that we could. We regard 
the decision as arbitrary but our reasoning was that the 
reading passages were clear and within his grasp, 
consequently, the fault was due to a poorly written 
item. Therefore, it would be appropriate to use his 
responses in the analysis. 

All of this might seem rather trivial but the 
problem Is fundamental. Because the taxonomy is reputedly 
hierarchical and cumulative, then performance at one level 
is contingent upon performance at the preceding level. 

In other words, if a student csinnot recall the appropriate 
content; l.e., if he falls a Knowledge item, then the 
same deficiency should appear in Comprehension items ^ in 
Application items, etc. If such answer sheets are 
accepted for inclusion in the item analyslis, then one 
knows in advance that item difficulties will be increased 
probably ascendingly through the upper levels. Also, the 
student’s level scores are likely to be misinterpreted 
because they do net accurately portray his mastery of the 
several processes. His lack of ’’Knowledge-' prevented 
him from applying the higher level processes. 






So the second major problem was how to regard 
the item analysis data for each of the levels once it nad 
been obtained. In the typical situation one strives for 
an average difficulty level of .50 unless he is purposely 
peaking the test and one also strives to reject items 
having sharp splits because they do not yield many 
dls criminations and they reduce external validity. But 
these guidelines do not hold for taxonomy-type tests 
where one knows on theoretical grounds that difficulties 
will increase as the level of the item increases and that 
item splits will depart rapid?ty from the prescribed 50/50 
split. Thus, to use established principles will yield a 
test which is at variance with the notion of a sequence 
of contingent tests each of which is more difficult than 
the next. Guidelines for constructing taxonomy-type 
tests have not been developed. New prlne5.ples are needed 
that would suggest the probable average difficulty of 
Comprehension items on the basis of known difficulties of 
Knowledge items, etc., through the taxonomy; that would 
forecast the number of sharp and nondiscriminating item 
splits which one might expect on the basis of predicted 
overall difficulty of a subtest, etc. 

These problems became even more complex when 
attempting to judge the item analysis data from the free 
response Evaluation and Synthesis items. There was no 
keyed response for them in the usual sense, they were 
the most difficult of all items and it would be expected 
that nearly every item would depart markedly from a 
50/50 split and still be va lid, and that the responses 
were scored on a quality sciale. We simply had no tools 
for coping with the data. If the responses were 
disappointing, we attempted to sharpen the item, but we 
held no expectancy about the nature of a quality point 
distribution of a good set of responses to a valid item. 
We attempted to compare perfortnance over grades for 
each of these items and tended to select items on which 
success increased as grade level Increased. Whether 
the Increased performance was due to Increased mastery 
of the processes or simply greater maturity is an open 
question. 



H. Preparation of Pinal Forms 

Pour final forms of tests were prepared in order 
to collect data with which to study the hypotheses. Two 
of these dealt with social science materials — the Lisbon 
Earthquake and Stages of Economic Growth— and the other 
two dealt with science materials — Atomic Structure and 



Glaciers. The differences between the science and social 
content are not nearly as sharp as we had planned them to 
be. Also, they should not be regarded as inter change able. 

Each form consists of two parts. Pai*t A contains 
directions 5 the reading passage, and items which reflect 
the first four leyels of the Taxonomy — Knowledge . 
Comprehension, Application, and Analysis. All Knowledge 
items appear first, then items for the other three levels 
appear in random order. There are twenty items for each 
of the four levels. Administration time is one hour. 

Part B contains directions and the items for Synthesis 
and Evaluation c Part A must be furnished to students 
when they take Part B in order that the reading passage 
is available to them. Part B contains five Synthesis 
items and ten. Evaluation items. The administration time 
is one hour. 

No studies were conducted on differential perform- 
ance on Parts A and B with regard to order of administration. 
Every student in the validatic-n sample took Part A then 
Part B. Until escperlments are done on order of presen- 
tation, the staff strongly recommends that they be 
administered in that order, tmd that Part B should not 
be administered unless Part A is too. 

^ The method of selecting items for each level for 
each form was as follows: On the basis of item analysis 

data from preliminary forms, students’ comments, and 
proctor observations all items were ridded, hopefully, 
of technical deficiencies and items were discarded which 
failed to correlate, positively with the subtest of which 
they were a part. When these two steps were achieved, 
then the item was placed in. a pool of items for that 
subtest and form. When the number of items to appear in 
the final form was determined, items were sampled from the 
pool until the needed number was obtained. It should be 
noted that the pools of items became increasingly 
smaller as the level of items increased. 

In the case of Synthesis and Evaluation items 
there was not a great deal of choice because of the 
limited number of items we were able to produce and 
because we did not know how to Interpret with any 
confidence the item analysis data which we obtained, 
except for the item-test correlations. However, each 
item was answered correctly more frequently as the grade 
level of the respondents increased. 
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IV. TKST ADMINISTRATION AND SCORING 



A. Test Administration 



.. This section describes the selection of schools, 
testing schedUies for the taxonomy-type tests and the 
cci^itlve aptitude tests, the format of the testing 
materials, test administration teams, test directions, 

SoUu6nt! i*6ciCt/ions to th6 t6s tings sind th© p^oc©dui^©o Tot 
scoring the tests.. . f c ux Aor 



All taxonomy-type tests and the cognitive 
tests were administered in Anril and May 

or 1965. 



Selection of Schools 




K 
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m 4.4 Florida State-Wide Ninth-Grade 

Program (which is compulsory for Florida public 
school students) were used to select schools for the 
taxonomy testing program. Schools were selected 

criteria: (a) they were located 

in^Florlda; (b.; they were willing to participate; 

the school mean scores achieved by their students 
fell between the ilOth and 60th percentiles on verbal 
^d quantitative ability as determined by state norms 
/j\ ^ breached as described subseouently) : 

pledge of suitable test administration 
conditions and cooperation by local school p..‘rsonnel . 



Only Florida schools were Included in the sample 
tZZ reasons. First, a sample of students from 

the state could be drawn which would have characteristics 
fexifliiar to a national sample. Second, scores on the 
oattery of achievement and ability tests from the two 
state-wide testing programs were available only for 
Florida students and these tests results would be useful 
in postproject studies of the concurrent validities of 
the taxonomy-type tests. 



Criterion (c) was established because it would 
whose students display a wide range of 
ability. After records were searched to identify 
schools which met the criterion, letters were prepared 
and senr to county school officials to request their 
part3.Sxpa.tion. The letter included a summary of the 
project ^d information about the number of students 
and the time from them which were needed. Only one 
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invitee could fit the testing program into his school 
calendar. Therefore the criterion was expanded to include 
a wider score range and a new set of invitations was 
extended. Eventually enough invitations wei*e accepted 
to yield the number of students needed. However, the 
ability level represented by these students is above 
average. The students from two of the schools are markedly 
above average. An explanation regarding these two schools 
is presented later. 

Table 7 contains a list of schools which were in 
the sample, their locations, and the number of taxonomy 
forms which were administered in each. 



TABLE 7 

Schools in the Taxonomy Testing Program 



School 


city 


County 


Number 
Taxonomy 
Adm. Each 
Subject 


Cocoa Beach High 


Cocoa Beach 


Brevard 


4 


Melbourne High 


Melbourne 


Brevard 


4 


Rickards Jr. High 


Ft. Lauderdale 


Broward 


4 


North .East High 


Ft. Lauderdale 


Broward 


4 


Walker Jr. High 


Bradenton 


Manatee 


2 


Manatee High 


Bradenton 


Manatee 


2 


South West Jr- ligh 


Lakeland 


Broward 


4 


Winter Haven Ki:?;h 


Winter Haven 


Polk 


2 


•Mainland Jr. High 


Daytona Beach 


Volusia 


4 


•Mainland Sr. High 


Daytona Beach 


Volusia 


4 



»Aiso designated for the Kit of Reference testing. 



I 

I 

I Table 0 contains the mean percentiles on the" 

■ School and College Ability Tests sjid the Metropolitan 

I Reading Test of the ninth-grade students in schools which 

were in the sample and in feeder schools which supplied 
students to schools which were included in the sanq>le. 

( Current test data were available only for ninth-grade 

students; consequently any judgment about the mean per- 
centile scores attained by tenth- throii^ twelfth-grade 
students in a sample school must be extrapolated from 

I the current ninth-grade means of students in that school 

or 9 if the school does not contain a ninth grade, from 
the principle feeder school* The staff believes the 
I ninth-grade means represent the overall school means 

I because no between ochool differential dropout factors 

I were noted. 
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TABLE 8 

Aptitude and Achievement Means for Sample Schools 
Having Ninth-ilrades and Feeder Schools for 
San^le Schools Without Ninth Grades 



School 

Number 


Sample 

School? 


Feeder 

School? 


1 


Yes 


Yes 


2 


No 


Yes 


3 


Yes 


Yes 


k 


Yes 


Yes 


5 


No 


Yes 


6 


Yes 


No 


7 


Yes 


Yes 


8 


' No 


Yes 



I 

b 



% 

SCAT Means Metropolitan 
V Q T Reading Test 



58 


64 


59 


48 


42 


47 


48 


. 48 


58 


75 


69 


62 


58 


47 


59 


62 


69 


47 


65 


48 


91 


56 


89 


90 


91 


93 


92 


90 


58 


34 


65 


48 
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It was stated earlier that two schools in the 
sample had high mean scores on the School and College 
Ability Test. One of these, a Junior high school, did 
not a senior high school in the sample; therefore, 

this high ability characteristic should not be general^ zed 
to any tenth-, eleventh-, or twelfth-grade group. The 
other high ability school was also a Junior high school 
and was a feeder school for a sample school. However, 
the overall effect of it as a feeder school is somewhat 
offset by a second feeder school which had substantially 
lower scores. Both were feeder schools for the same 
senior high school in the sample. These schools were 
included because they were needed and because they met 
all criteria except the one about ability. However, the 
selections were made only after winning the assurance by 
principals that they would select students to participate 
who would represent as complete a range of ability as 
possible. The number of students consisting each form 
^2 schools was relatively small and an examination 

or the test performances indicates that no bias was 
probably introduced by their inclusion. In the majority 
or schools, all students were scheduled to take all four 
taxonomy forms; but in a few instances students were 
scheduled to take only two forms ^ Therefore, scores 
were available for a minimum of two forms and for four 
forms for each student. 



The enrollment of the sample schools ranged from 
appTOxiroately 200 per grade to slightly more than 500 per 
® j n smallest group completing any form was forty 
and the largest group was slightly more than 500. It 
was the opinion of the project staff that the socio- 
economic status of these students was predominantly middle 
class. Very few students of low socio-economic status 

were Included because of the manner in which schooTs 
were selected. 



Testing Schedules 

The order for administering the taxononqr forms 
was determined within these restrictions: (a) the first 

fom to be administered would not be Atomic Structure 
(b) test contents l.e., social science and science, was 
alternated over administrations 5 and (c) within restrictions 
(a) and (b), the order was established randomly. 

In every administration. Part A (Knowledge, 
Comprehension, Application, and Analysis) of a given 
taxonomy-type test was followed immediately by administering 







I! 



iJ 



I 



i 

I 



61 



Part B (Synthesis and Evaluation), of that form^ The 
students had a short break between Parts A and B. In 
most cases, the two parts were adsdnlstered In ttuccesslve 
class periods. In no Instance were two forms adimlnlstered 
without a substantial Intervening period of time. The 
minimum break was ^ lunch period, and In most cases the 
forms were administered on successive days. 



Administration of the KIT Tests 

In one county the Kit of Reference Tests (KIT) 
was administered to students In grades nine throu^ 
twelve In addition to the taxonomy-type tests. The 
KIT tests are designed to measure specific cognitive 
factors . 



The taxonomy and KIT testing schedule was 
designed to (a) maximise the time between the admin- 
istration of taxonomy forms; (b) maximize the time between 
the administration of pairs of KIT subtests which measure 
the same factor; (c) minimize the total testing time 
required of each pupil; and (d) fit the testing schedules 
within the time periods which were made available by the 
schools. Testing of ninth-grade students was completed 
within a period of five days, with alternate morning 
and afternoon testing periods. For students from grades 
ten, eleven, a:id twelve, testing was scheduled only for 
mornings and was distributed over a three week period. 



Format of Testing Materials 

Each taxonomy form consisted of two parts: 

Part A contains the reading passage and 80 multiple choice 
Items evenly divided among Knowledge, Comprehension, 
Application, and Analysis. Part B contains five free- 
response Items for Synthesis and ten free-response Items 
for Evaluation. Directions are printed on the cover 
page of both parts. The tests were produced by the 
photo-offset duplicating process. The completed forms 
measured seven inches by ten Inches. The test forms 
In their entirety are reproduced In Appendices A through D. 



Test Administration Teams 

All tests were administered by teams consisting 
of project staff members and local school personnel. 

One member of the project staff was responsible for the 
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^c^udX t/6S'u ^dmXnist/Psil/ion £tnd ^hG o^hGP i&GinbGFS sGPVGd 
as proctors. Observation of behavior during <test 
adioinistration ^as hainpered in four schools where 
students remained in classrooms and received directions 
via public address systems. ‘ In all four schools, this 

method of testing was common and created no unusual 
problems. 

In all schools, meetings were held with the faculty 
to discuss the project, explain its goals, and to answer 
^y questions about the project or testing procedures. 

In general, all local school personnel were most cooperative. 
A negative attitude toward the testing program on the part 
Of teachers in one school was detected near the end of the 
testing program. There is a possibility that some of 
this negative feeling was reflected by the pupils in their 
performance. 



Directions to Students 

The actual administration of the tests followed 
generally accepted procedures. Sp<‘clfic directions which 

the students and other details of administration 
appear in Appendix E. 



kit battery consisted of 37 subtests, which 

measured seventeen specific factors. A mlnlstuifi of two 
tests per factor, was used. These subtests were grouped 
into batteries on the basis of the amount of time available 
for admnlstration and to maximize the variety of factors 
at each sitting. These batteries were mimeographed with 
uiiG exeepuxon of subtest R-3 (Ship Destination) and suhf.est 

(Logical Reasoning) which were obtained from the 
publisher. 



Student Reactions 

The students spent the first ten to fifteen 
^nutes reading the passage. The directions did not 
indjwcate a specific time limit for reading the passage* 

to read the passage and then begin 
to answer the items. Pew students atten5)ted to answer 

the entire passage. Questions which 
students asked while reading the passage dealt n.«<my 

with vocabulary. Most of the questions about the reading 
pasoap were asked while the students were responding to 

h of these questions 

graphs. (The students fousid thz 
Table of Atomic Structure to be quite difficult to 
understand. ) 
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In general., the students reacted to Part A in 
the same manner a» one would expect for conventional 
4 :naJor problem seemed tc> be their 

inability and/or unwillingness to intei7>ret the charts 
and graphs* Other problems arose due t<» inadeauate 
vocabularies. 

The most frequent comment occurring during 
Part B was '’I don’t know the right answor" which was 
frequently given in response to requestjf that they try 
to complete all item^ . The proctors wei*e frequently 

asked to read responses and react to them, but this was 
not done. 

Discipline was not a major problem. The presence 
or local school personnel probably accounts for it. 
Students who completed the test before ^ime expired were 
asked to read other materials which the? had been 
requeL^ted to bring with them. A few is >lated instances 
of rancom marking were observed and those students were 
requested to try to answer the questions or to leave 
the answer positions blank. 

Wl\enever possible, time was all .wed for students 
^ ask questions after completing the last taxonomy form, 
^elr questions Mght be categojMzed as follows: 

Requests for correct answers to specific items of Part A* 
requests for opinions about specific responses given to 
Synthesis items; and the purpose of the tests. 

u ^ examiners overheard several conversations 
by students about the tests. Generally, the topic was 

ability students, as identified 
by their teachers, seemed to regard the taxonomy-type 
tests as a challenge and appeared to enjoy the Synthesis 
and Evaluation items more than they did the oth.\ers. 

Tbe motivational level of the students was 

a sU^htly lower level thim is desirable. 
In all schools, s^/Udexits asked the examiners if the 
results would be placed on their permanent records. The 
students were told that the results would be returned 
to their schools and the principals would decide what use 
to make of them. The fact that these tests were 
experimental tests was Indicated in the introductory 
comments and appeared on the cover sheet of the booklets. 
M^y students drew the conclusion that the results of 
the tests would, therefore, be meaningless to them. 
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13. Test Scoring 

TRM multiple-choice items were scored on an 

machine. The free-response items were 
scored by persons who were hi:r=ed specif leal iv fnr 

purpose and who worfc-d directly under thlsuoerrtsion 

Of project fttaff members. Thl? scoring «t 

according to the following crlterta:' no'oSorlmeriin^ 

yews"f^^on«?“f a ’ «°“Ple*ed at iLst Sret 
employment test which was one of fSe tlllloZ 

by the p^ecFstaff.’^*’^^®"^"* scoring cri: sri'a developed 

n I’ j ^he Synthesis Items were scored o' a £**alf* of* 

0-1 and Valuation items were scored on o‘. 1 2 scale 

Eva?Sr&**.n^""*^°? “f Synthesis ml 

c.vaxuaT:ion items appears In Appendix E, 

to Synthfsl^Jte^^lon^Le"^’'’*® responses 

iteiM for one form were developed bv orolerst 

staff and presented to the scoring staff Thev L^ ' 

*2 1!*“^ criterion ladles 'for r«lven 

of reMon8e8***A’^J^i«\**f^S ® limited saanple 

STOring! When he‘^f^?t®Jh«^*ff their 

they were scoring was accurate 

instructed to assign scores. In the earlv 

s^ ®" * different IftL of tL 

llZir i^dWr^l^nrsIpa^K"® luo 

qSaUtf lintrSrbecause 

».r.sr;£H 

SSs"' - -s.— !t» 

^ . Por these reasons the procedures were mod^ Ti 

for subsequent taxonomy fonaa Thi* rooaiiaed 

selected Lntatlve cXSffir 

r *® **’® ®*®" <Si3cuffi: D^g this 
meeting, each scorer reviewed u*x«g bins 

qjwstlonable responses to the reBalnd.r*of*^thf'a*-S^*r®^®^ 
discussion and decision A Lt ^ ®"® 

developed by this process and it ^asISed M'lrlterlaf 
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The procedtires followed for scoring Evaluation 
iteiris were essentially the same as those which were 
developed for scoring Synthesis items. 

Additional quality control was maintained in an 
informal way through staff discussion of responses which 
were difficult to score. These responses were presented 
to the project staff members for decision. Also, the 
projeci; staff rescored answer sheets which had already 
been scored by the scoring staff. A conservative 
estimate of the number of scorable responses which were 
double<>8 cored would be one item in ten for Synthesis and 
one in twenty for Evaluation. 

The KIT tests were scored by a trained staff 
different from the taxonomy scoring staff. This staff 
had been trained earlier when they were employed on 
another project. Quality control was maintained by 
randomly selecting papers and having project staff 
rescore them. 

Conq>lete information about the scoring of the 
taxonomy-type tests including sample responses appears 
in Appendix E. 









V. STATISTICAL DATA ABOUT THE TAXONOMY POEMS 



The purpose of this section is to present summary 
data about the taxonomy-t 3 rpe tests. These data» in conjunc- 
tion with certali ov^her data which are presented in the 
Appendices, are intended to give to potential users of the 
test foxms as complete a statistical representation of the 
tests as is possible. 

The means and standard deviations by grade and taxonomy 
level over schoolrr^ some reliability data, and the intercor- 
relations of levels by grade and over forms and schools are 
presented here, along with some cautions in their interpre- 
tation. 



Appendices A through D, each of which is devoted 
exclusively to one of the test forms, contain for each form 
the item distribution data, item-level correlations, percentile 
distributions, and reliability estimates for levels Knowledge 
through Analysis. Reliability data for Synthesis and Evalu- 
ation are contained in Appendix E. 

Most of the information presented in this section 
serves as the basis for testing the hypotheses about the 
hierarchical cumulativeness of the taxonomy and the transcend- 
ence of the processes, the results of which appear in Section 
VI. 



A. Means and Standard Deviations 

The test foimns were administered in ten different 
schools to a total of twenty-three different gr*ade groups. 
The smallest grade-group consisted of forty-one students and 
the largest consisted of 508 students. 

The means and standard deviations by level, form, 
and grade over schools appear in Table 9. The lowest and 
highest school means for each level by grade appear in Table 
10 . 



The chance mean for each of the first four levels is 
five (twenty four-choic.e items for each level) and the chance 
means on Synthesis and Evaluation are indeterminate because 
both sets of items are in a free-response format. 

The tabular data reveal that means increase with grade 
level, means decrease as level increases within grade, and 
that there is no clear single pattern of change of standard 
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OABLE 9 

Means and Standard Deviations for 
Taxonomy Norms within Grade and Over Sphools 






Atomic structure Glaciers 



— L Ts ron — 
Earthquake 



•g g O nOBild ' 
Growth 



Grade 9 



K 

C 

Ap 

An 

Sy 

£v 



K 

n 



12.98 

6.94 

6.38 

5.22 

0.49 

1.20, 



N * 1184 



4.08 

2 .Q0 

2; 88 
2.56 
0.90 
1.44 



15.66 
7.71 
8 .- ' 



I 



3.71 

3.24 

3.71 

2.79 

2.03 

2.90 



48 
6.27 
.06 
.17 
1223 

Grade 10 



15.87 

6.78 

2.43 

1.93 



1199 



3.28 

3.60 

3.26 

3.08 

1.78 

1.98 



14.32 

8.19 

8.13 

6.24 

1.23 

0.75 



4.18 

3.53 

3.51 

2.78 

1.29 

1.11 



An 

Sy 

Ev 



1«.05 

« oi 

W* G»X 

7.83 

6*35 

0.94 
1.56 
» = 1422 



4.24 

3.37 

3.39 




1.78 



16.42 

8.86 

9.55 
7.25 
1.81 



3.62 

3.42 

3.83 

2.96 

2.23 



4.64 3.23 



16 .86 
11.65 
9.93 

7.98 

3.60 

2.25 



1.98 

[.87 



1455 



2 , 

i‘.68 

2.38 



1199 






3.63 




Grade 11 



K 




4.66 


17.06 


3.26 


17.33 


2.65 


C 


8.46 


3.90 


9.65 


3.52 


12.47 


3.86 


Ap 


8.21 


3.98 


10.58 


3.90 


10.58 


3.62 


An 


6.82 


3.45 


7.61 


3.01 


8.64 


3.63 


Sy 


1.17 


i.54 


3.98 


2.40 


3.87 


2.49 


Ev 


1.69. 


1.95 


5.16 


3.31 


2e84 


2.55 




N » 1261 


1309 


1303 



9.40 

9-23 
7.06 
1.79 

.97 1.30 
1384 



15.91 3.56 
10.18 4.18 
10.02 3.93 
7.69 3.39 
2.39 2.02 
1=18 1.4l 
1291 



Grade 12 



K 


15.26 


3.63 


17.41 


2.91 


17.78 


2.24 


16.21 


3.55 


C 


0.92 


3.55 


9.91 




13.37 


3.49 


10.70 


3.93 


Ap 


8.71 


3.66 


10.66 


3.88 


11.45 


3.42 


10.56 


3.75 


An 


7.02 


3.35 


7.90 


2.95 


9.50 


3.60 


8.14 


3.40 


Sy 


1.40 


1.60 


4,r04 


2.34 


4.43 


2.40 


2.40 


1.86 


Ev 

N 


2.10 
= 1197 


2.06 




3.03 2.54 
1192 


1.38 1.49 
1194 
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TABLE 10 

Range of School Mean Scores within Grade 



Atomic Structure 



Glaciers 



Lisbon Economic 

gggWl?h-„ 



Grade 9 



K 


12.04 


14.12 


15.14 


16.60 


C 

Ap 


4.85 

4.50 


7.69 

7 .o 5 


6.63 

7.32 


8.39 

8.^ 


An 


3.25 


5.69 


5.11 


7.40 


Sy 


.30 


.70 


2.22 


3.75 


Ev 


1.10 


1.22 


3.11 


5.45 








Grade 10 


K 


13.16 


16.10 


15.08 


17.16 


C 


5.13 


11.02 


6.98 


10.14 


Ap 


5.16 


10.02 


7.76 


11.57 


An 


3.67 


9.08 


5.50 


8.16 


Sy 


.55 


1.49 


3.22 


4.56 


Ev 


1.33 


2.72 


3.57 


7.23 



15.41 


16.71 


12.70 


15.4^+ 


9.41 


11.28 


7*93 


9.13 


8.31 


9.41 


7.77 


9.15 


6.03 


7.48 


5.53 


6.54 


2.01 


2.97 


1.03 


1.60 


1.31 


2.56 


.36 


.93 


15.68 


18.42 


13.49 


15.98 


9.04 


14.96 


I-®? 


10.87 


8.10 


13.10 


8.34 


10.70 


6.42 


11.34 


5.02 


8.70 


2.22 


7.24 


1.22 


2.43 


1.31 


5.74 


.48 


2.17 



Grade 11 



K 

C 

Ap 

An 

Sy 

Ev 



11.13 16.53 16.52 

6.03 11.55 8.75 

5.85 11.32 9.57 

4.95 9.11 7.15 

.64 1.90 2.87 

1.35 2.86 4.47 



17.53 16.75 17.72 
10.67 10.95 13.46 

11.53 9.28 11.81 
8.20 7.52 9.63 
4.80 2.57 5.96 
7.11 1.86 5.<>3 



14.21 16.68 
7.26 11.48 
7.46 12.32 

5.44 8.75 
1.42 3.17 
.65 2.00 



Grade 12 



K 


13.86 


15.93 


16.75 


17.94 


17.20 


C 


5.02 


10.31 


9.03 


10.63 


12.40 


Ap 


6.08 


9.61 


9.57 


11.35 


10.68 


An 


4.27 


1.85 


7.36 


8.56 


8.53 


Sy 


.54 


1.67 




4.92 


2.95 


Ev 


1.36 


3.20 


5.88 


6.94 


1.64 



18.12 

13.81 

11.84 

9.74 

5.98 

5.02 



13.93 

9.11 

9.06 

6.60 

1.58 

.82 



17.01 

11.53 

11.23 

8.70 

3.10 

1.85 
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deviations over grades or over levels 
general tendencies are to be expected 
point of the Imputed structure of the 
of the tests %^hich were constructed# 



within grades . These 
from the Joint stand- 
Ta^onomy and the nature 



The exception to these tendencies are the reversal 
from expectancy of the Comprehension and Application means at 
all grade levels on the Glaciers test and the general lack of 
order of the Synthesis and Evaluation means. The former is 
due to some Comprehension items which dealt with obscure 
inf option in the reading passage » The latter can more 
readily be commented about than explained. All Synthesis 
items preceded the Evaluation items , so there was an element 
of practice which might have augmented the responses to the 
Evaluation items* The Evaluation items were more structured 
and could in some Instances be attempted on a common sense 
basis. The Evaluation items called for the evaluation of 
situations on the basis of Internal and external criteria, the 
X3.tt@r b8lng external to the reading passage and therefore 
not amenable to control by the test authors. The Synthesis 
items were unique, according to student testtoony, whereas 

3?egarded as more commonly encounterec 
in school settings than were the Synthesis items, 

•!« rnaKi t^^xonowy-type tests appear 
11* The coefficients are computed over grades. 

Within grade coefficients are probably substantially smaller 
than those reported for Knowledge through Analysis. The 

Evaluation coefficients within grade are probably 
of the same magnitudes as thocie which are presented* 



C. Intercorrelations 



Matrices of intercorrelations were computed for th<=» 
complete battery of taxonomy-type tests. A total of twenty- 
four scores (six levels by four forms) were available for 
students who took all tests; however due to student absences 
and our scheduling some students to take only two forms, a 
substantial number of the test records were incomplete, 

necessary to use a missing-point corre- 
lation routine for developing the matrices. A 24 x 2^1 matrix 
^ as computed on students from each of grades nine through 
twelve. These matrices are presented in Tables 12, ninth 

eleventh grade; 15, twelfth grade: 

and lOj all grades combined. 



The number of cases contributing 
does not appear in these tables, but the 
students contributing to any coefficient 



to each correlation 
minimum number of 
is included. This 
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TABie 21 

OSfar Qrades of Taxonoegr Scoret» 



Atoale Str^turo CQjtelero Llsbc^ Bs^hg^uake Econeaio Qrowth 







l/Orreei^e^ 


Bas ^^Correeied 


RSH cmreeted 


Raw 


bcoTee^ed 




Score 


Score 


Score Score 


Seoa^e Seora 


Score 


Soora 


K 


«836 


.929 


.816 .9X9 


.758 .885 


.821j 


.921* 


C 


.693 


,8a 


.677 .815 


.7^ .862 


.71^ 


.867 


Ap 


069 k 


.826 


.731 .857 


.£89 ,831t 


.7a 


.862 


An 


.632 


•760 


.539 .706 


CO 

# 

• 


.614 


.763 


Sy 




.89 


.72 


.71 




.79 


Et 




•83 


.75 


.81 




.72 



Kf 0, Ap, and An, XR 20*o «re sfeporbed aod eaob. lo based 
ajppraadioa'teOli^ 5>000 sttidesito* Poop S sod E, the ooeffloleats are 
interj;idge reliabilities asd the igsthod of ooepitatis^ is deseribed in 
Appiofiis £(» 
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nlnlsnin nuab 6 r Is 
3B50 for the over 



750 students for the by«>ffrsde tebles end 
grades table. 



D. Cautions in Interpreting Results 

B«caase the taxonomy la reputedly structured from 
c<KsplM basis a>^ is cumulatively hierarchical the 
tota from tests construct^id according to its structure should 

characteristics. Furthermore, the 
constructed have such short subtests 
that differences between adjacent 
*** Both of these factors make It 

< 3 ata be Interpreted cautiously 
and with a full knowledge of their special characteristics. 



Interpreting Means 



*•>« “*«“» decrease as level 
ove^Sfd«^***Tl? that the means Increase within level 

hl^.^ dnould also be noted that the score distance 

within grade are generally less than 
^*^^*ti.on of the scores from either level. It 
“oted that the score difference between means 

«»» .JoidlS J*"®? adjacent grades is also generally ic^s than 
the standard deviation of scores at either grade level. 

ftftimiPfi standard deviations, 

coupled with the ?-eliability data, is that statements of 

fin be confined to group differences. The data 

precise to warrant intralndivldual 
comparisons. If such comparisons are 
attempted, then it should be done only after actually 

calculating the significance of the differences which is to 
oe Interpreted. 



Interpreting Correlations 

44.V 1. P'® reader should interpret the Intercorrelations 

caution or special insight which comes from 
imowlng that all, except a few, bivariate distributions of 

^angular. The assumption of a normal 
bivariate distribution on which the Pearson product-moment 
correlation rests was not met by the taxonomy data^ Never- 
theless, product-moment correlations were computed because 
no other measure of association which would be completely 

identified. Because the entire routine 
ror testing the hypotheses and the psychological structure of 



the taxonomy is based on the analyses of correlational data, 
whatever caution is used when ihtex7>reting these intercorre- 
lations should certainly be carried over and applied to the 
entire contents of Section VI. 

If the structure of the taxonomy is valid, then it 
fellOKB that an individual's true score at one level will 
establish the ceiling of his true score at the next higher 
level; l.e., an individual’s score at one level of the 
taxonomy will be equal to the highest score he can thoretically 
attain on the next higher 'evel. In short, the bivariate 
distributions of scores will be triangular. 



Norms 

There appear in Appendices A through D percentile 
^ulvalents of raw scores for each level of the taxonomy forms. 

prepared yid included because it is the ccnventional 
tMng to do. We believe they should be Ignored . At best, 
they merely describe the frequency data in terms which probably 
are more meaningful to the layman than are the raw scores. 

have strong feelings about the Inappropriateness 
or the percentile equivalent scores for these reasons. 

range of raw score points is too narrow to 
warrant calculating percentiles or, for that matter, any 
. normative score. 



Second, the underlying raw score distributions are 

structure is valid, then score 
1 isvels should be increasingly skewed as 

However, the theoretical distribution for 
should either be normal or there should be 

whatever. The latter would be ideal for 
the tests we constructed. 



second reasons are based on 
the data which lead to tremendous differ- 
ences between percentile equivalents of adjacent raw scores. 

2^® unaware of the existence of any norm 
meaningfully with taxonomy-type data. 

® several taxonomic levels are 

llSlt of ^^'22221 His score on Knowledge defines the 

dSlLffSi 5o®P**eHension, his score on Comprehension 

score on Application, etc. It seems 
to us that a new norming technique will have to be devised 
for taxonomy-type tests which will have to take into amount 



the dependency noted above and to reconcile the fact that 
scores from taxonomy-type tests are partially Ipsatlve and 
partially normative. 



Reliability 

The Interpretation of the reliability data Is also 
somewhat clouded because of the nature of the score distri- 
butions and the method of calculation which was used. 

The apparently Ideal method of deteimlnlng reliability 
would have been test-retest but Its use was precluded for two 
reasons. First, we did not have access to students for addi- 
tional testing. Second, It Is quite probable that there would 
be marked changes In the process levels of the Items on the 
second administration due to learning during and memory of the 
first administration. Whether it would be Justifiable to 
compute test-retest reliability on this basis Is a question 
which can be 6Uiswered only by the results of subsequent empir- 
ical study. The use of alternate forms; e.g.. Atomic Structure 
and Glaciers, as a method of determining reliability would 
haive been Illogical in this :atudy because one purpose of the 
study was to determine the generality of processes over specific 
contents. Because of these facts, the KR 20 was regarded as 
the most appropriate technique of those which were available. 

Nevertheless, the meaningfulness of the coefficients 
which are presented for the first four levels are somewhat 
questionable because of the nature of the score distributions. 
Because difficulty should Increase as level Increases, It will 
probably be the case that the magnitude of Internal consistency 
coefficients will decrease as level Increases. Consequently, 
it seems that the proper evaluation of the obtained coefficients 
should be In terms of a set of level coefficients which would 
be theoretically generated on the bases of the increments in 
difficulty from one level to the next. Unfortunately, we 
were unable to develop this set of theoretical coefficients. 
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VI, ANALYSIS AND PRESENTATION OP RESULTS 



This section describes the procedures for and results 
of testing the hypotheses. The first part deals with the 
hypothesis of hierarchical structure; the second part deals 
with the hypothesis of generality of process over content; 
and the third part deals with the psychological structure of 
the taxonomy-type tests. 



A . Hierarchical Stznicture 

The T ^onomy is claimed to be hierarchical according 
to complexity from aiowledge through Evaluation, and to be 
emulative in that any level of process includes the processes 
of all lower levels. As noted in Section II, this feature 
is considered to be an entry point for one who wishes to 
determine the construct validity of the Taxonomy , If the 
hierarchical structure cannot be demonstrated, then the 
taxonomy is of limited usefulness. 



Procedure 

To examine the cumulative hierarchical structure, it 
was hypothesissed that data from the taxonomy-type tests should 
following characteristics: (a) the mean scores on 

suotests decrease as the taxonomic levels of the subtests 

Intercorrelation matrix of taxonomic 

simplex structure when Judged in terms 
of the hypothesized structure. 



To examine the hypothesis that mean 
°*!®®T®®®^pp^a5Tevei of eompisxlty Increases, the mean 

battery was computed 

o? twelve. The approximate numbers 

®0"^:*’ltutlng to each mean were 1,200 for grade 

fw%ade°twelve®^“^® eleven, and 1,200 



s t ructure . According to Guttman's simple: 
<-M« tests differ only in complexity, then . 

observable In a matrix of Intercorrelatlons 
aa y**® tests. According to the theory, 
then**'^*^ earlier in Section 1, if a perfect simplex exists. 



*'lk ■ ^‘Ijrjic where KJ <k. 
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If this condition is satisfied^ the correlation matrix 
will be such that the largest values will lie along the prin- 
cipal diagonal y followed by the next larger values in the 
adjacent diagonals ^ with the smallest va3.ues in the upper 
rlghl; and lower left, comers, 



Kaiser (1962) proposed a method of scaling a simplex 
through a least squares analysis procedure. By applying his 
method to all possible orders of variables in a matrix, one 
can arrive at a be.it order. In addition, he proposes ^ a method 

^ statistic which indicates the goodness 
or fit of the data to the model. As the sum of squares accounted 
for by a given order approaches the total suiii of squares, cfi 
approaches unity. ‘3?heref or^=» , the best order would be one which 
yields the maximum q2 statistic. 

Twenty 6x6 intercorrelation matrices were analysed 
for simplex structure, one far each grade for each form and 

combined. Correlations were 
attenuation prior to the analysis. In each 
c^alysls, the Knowledge subtest was held as level 1 and the 
other five subtests were permuted. Therefore, 120 analyses 

combination. The decision to 

thl hli to? J?® Knowledge subtest as level 1 was baaed on 
vhe bexief that it was the least complex process because all 
relevant content to be used in responding to the Knowledge 
items was available to the student during the time he took 

ull6 v6S u • 



Results 



* T^® results of the analysis of mean scores appear 

ill considering them the reader should remember 

that the chance means on. the Knowledge, Comprehension Annii- 
cation, and Analyses subtlest s are five and that the chance 

Evaluation subtasta arrinSItaSte 
because their items were in a free-response format, 

of meana'^^a imhoi preflicted pattern 

^ grade levels on the Lisbon Earthouake 

for of 

ror zne two forms. Atomic Structure and Glaciers, whlefe are 

contain several departures from the 
patterns, For each form and at eveiw grade level 

fSr tKlc?err?S?r.‘^? Vr SyntS^S 

are higher than the Comprehenilon^meMsl^* Application sioans 
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TABLE 17 

Comparison of Mean ”^erformance on 
Florida Tajconoiuy Battery 

Grade 



Atomic Structure 




Process 


9 


Knowledge 


13.0 


Comprehension 


6.9 


Application 


6.4 


Analysis 


5.2 


Synthesis 


.5 


Evaluation 


1.2 


Glaciers 




Process 


9 


Knowledge 


15.7 


Comprehension 


7.7 


Application 


8.5 


Analysis 


6.3 


Synthesis 


3.1 


Evaluation 


4.2 


Lisbon Earthquake 






9 


Process 




Knowledge 


15.9 


Comprehension 


10.4 


Application 


8.5 


Analysis 


6.8 


Synthesis 


2.4 


Eva].uation 


1.9 


Stages of 




Economic Growth 




Process 


9 


Knowledge 


14.3 


Comprehension 


8.2 


Application 


8.1 


Analysis 


6.2 


Synthesis 


1.2 


Evaluation 


.7 



10 


11 


12 


14.0 


14.0 


15.3 


8.2 


8.5 


8.9 


7c8 


8.2 


8.7 


6.3 


6.8 


7.0 


•9 


1.2 


1.4 


1.6 


1.7 


2.1 


10 


11 


12 


16.4 


17.1 


17.4 


8.9 


9.7 


9.9 


9.5 


10.6 


10.7 


7.2 

3.8 


7.6 

4.0 


7.9 

4.0 


4.6 


5.2 


5.6 


10 


11 


12 


16.9 


17.3 


17.8 


11.7 


12.5 


13.4 


9.9 


10.6 


11.4 


8.0 


8.6 


9*5 


3.6 


3.9 


4.4 


2.3 


2.8 


3.0 



10 


11 


12 


15.1 


15.9 


16.2 


9. ft 


10.2 


10.7 


9.S 


10.0 


10,6 


7.1 


7.7 


8.1 


1.8 


2.4 


2.4 


1.0 


1.2 


1.4 
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The extent of similarity between these patterns 
of means and the predicted pattern is regau?ded as generally 
supporting the hypothesis, but that support Is not unlvocal 
because the science forms contained several systematic 
inconsistencies. But on balance, it appears that the data 
lend more support to accepting the hypothesis them rejecting 
it • 



Simplex st^cture . Original correlations and correlations 
corrected for attenuation for each grade appear in Table 18, 
and comparable coefficients for all grades combined appear 
In Table 19. A summary of results of the simplex analyses 
for the Atomic Structure and Glaciers tests appears in Table 
20 and the summary for the Lisbon Earthquake and Stages of 
Economic Growth tests appears in Table 21, 

The simplex analyses reveal that for only the Lisbon 
Earthquake form does the taxonomic arrangement according to 
complexity correspond to the empirically determined order of 
complexity at each of the grade levels and over grades. The 
Atomic Structure form contains only one discrepancy between 
the theoretical and actual order of complexity. It occurs 
only at the ninth-grade level where the empirical ordering 
places Synthesis and Evaluation between Knowledge ai 1 
Comprehension, The Stages of Economic Growth fonn contains 
only two discrepancies. In grade nine Synthesis is empir- 
ically placed between Knowledge and Comprehension; and in 
^ade twelve. Synthesis and Evaluation are reversed. The 
Glaciers form reveals the same empirical pattern at all grade 
levels; Synthesis falls in that order between Knowledge and 
Comprehension, 

The hypothesis of simpllcal structure appears not to 
be supported or rejected by the results. There is no statis- 
v>ical test of g^ignlficanice with which to reach a summary 
Judgment about whether there Is a non-chance relationship 
between the empirical order and the theoretical order. In 
the absence of it and for reasons that are presented subse- 
quently, the evidence is regarded in the main as more 
confirming than dlsconfirming of the hypothesis ^ 



Discussion of Results 

The evidence about the hypotheses which was provided 
by the patterns of means auid the simpllcal arrangements 
according to complexity is such that no definite assertion 
can be made about whether or not the taxonomic processes are 
arranged in hierarchical order. But the evidence and other 
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■KVslaes aboT<e diagorials are eriglnal coxTel^ition coefTlclents; 
Those below the diagonal are corrected Xor attenuation. Decimal 
points haTS been omitted. 
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l!ABLg 19 
Correlations and 

Correlations Corrected for Attsatuatlon* 
All Grades Together 
Atosnlc Structure 



Kiowledge 

Conprehension 

Application 

Analysis 

Synthesis 

Evaluation 

N * 5057 



Ifeowledge 

Cosqprehension 

Application 

Analysis 

Synthesis 

Evaluation 

K » 5143 



Kfiowledge 

Conq;)rehension 

Application 

Analysis 

Synthesis 

Evaluation 

N » 5135 



Knowledge 

Conqprehension 

Application 

Analysis 

Synthesis 

Evaluation 

N « 5^)59 



K 

6?5 

651 

tif 

403 



c 

514 

§S9 




Ap 

496 

712 

955 

573 

459 



An 




Glaciers 



648 

664 

529 

‘9 

27 



C 

481 

992 

999 

533 

535 



Ap 

lU 

978 

567 

532 



Lisbon Earthquake 
Ap 

564 

719 

m 

m 



K 

76:i 

783 

692 

.663 

434 



C 

57? 
)9 

n 



632 



494 

406 



An 

i 

614 
>3 



iin 

498 

675 





801 

505 



Stages of Econosjiie Growth 


K 


C 


Ap 


An 


654 


512 


503 

753 


liS 


655 

4?4 


999 


924 


619 


477 

459 


645 


6^ 

628 


610 

597 



Sy 

4X2 

415 

450 

371 

496 



Sy 

298 

flZ 

4U 

331 

376 



Sy 

486 

551 

562 

558 

597 



ay 

385 




424 

543 



Er 

386 




294 

426 



B\r 

409 

382 

394 

295 

277 



Ev 

340 

379 



m 



Ev 




455 

597 



di^nale are original correUtlon 
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TABLE 20 

Results of Simplex Analyses 



Atomic Structure 









Grades 






9 


10 


11 


12 


Maximum 
Obtained 
^ Value 


.89 


.92 


.92 


.92 


Order of Process 
Levels Leading to 
Maximum Value 


1-5-6- 

2-3-4 


1-2-3- 

4-5-6 


1-2-3- 

4-5-6 


1-2-3- 

4-5-0 


Deviation of 
for Hypothesized 
Order from 
Meocimum Obtained 


.17 


.00 


.00 


.00 




Glaciers 












Grades 






9 


10 


11 


12 


Maximum 
0^1/8ijLn6d 
q^ Value 


.90 


.91 


.89 


.89 


Order of Process 
Levels Leading to 
Maximum q*^ Value 


1-6-2- 

3-4-6 


1—6—2— 

3-4-5 


1-6-2.- 

3-4-5 


1-6-2- 

3-4-5 


Deviation of q^ 
for Hypothesized 
07**der from 
Maximum Obtained 


.08 


.07 


.08 


.02 



All 

grades 

.91 

1-2-3- 

4 - 5-0 

•00 

All 

grades 

.95 

1 - 6 - 2 - 

3-4-5 

.13 
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TABLE 21 

Resalts of Sii^lex Analyses 



Lisbon Earthquake 

Grades 



M8Lxlmum 

Obtained 

Value 

Order of Process 
Levels Leading to 
Maximum q^ Value 

Deviation of q2 
for Hypothesized 
Order from 
Maximum Obtained 



9 


10 


11 


12 


All 

grades 


•95. 


.986 


.995 


.983 


.991 


1-2-3- 

4-5-6 


1-2-3- 

4-5-6 


1-2-3- 

4-5-6 


1-2-3- 

4-5-6 


1-2-3- 

4-5-6 



Scages of Economic Growth 









Grades 






9 


10 


11 


12 


Maximum 
Obtained 
q^ Value 


.86 


.90 


• 

VO 


.92 


Order of Process 
Levels Leading to 
Maximum q^ Value 


3-4.6 


1-2-3- 

4-5-6 


1-2-3- 

4-5-6 


1-2-3- 

4-5-6 


Deviation of 
for Hypothesized 
Order from 
Maximiun Obtained 


.03 


.00 


0 

0 

• 


.01 



All 

grades 



.91 



1 - 2 -: 



.00 






o 

, ERIC 
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information about the tests lead to the belief that there is 
more confirmation than disconfirmation. The reasons for this 
are as follows. 



First, only two kinds of discrepancies in means 
occurred; Application and Comprehension were reversed at all 
grade levels on one form, and on that form and the other 
science-content form Synthesis and Evaluation were reversed 
at all grade levels. With regsird to the former, the average 
difference between the two means was about ,7 and no pair 
of the means differed by as much as 1,0, The item analyses 
data, which appears in Appendix B, reveal that two of the 
Comprehension items were exceedingly difficult. If the reader 
attempts to solve these two items then he will probably have 
to read the content passages in the test booklet several times 
before he locates the appropriate infoimiation. The information 
is there but it is very brief and it is not conspicuously 
located. There is little doubt that had two other Compre- 
hension items been chosen for inclusion in the passage then 
this reversal would not have occurred. 



The reversal of Synthesis and Evaluation means on the 
two science-content forms at all grade levels requires a much 
more involved explanation. First, the reader will recall 
from earlier sections that we had least confidence in the 
technical quality of the Synthesis and Evaluation items, that 
our misgivings were greater about the Evaluation items than 
the Synthesis items because some of the former ones required 
applying external criteria which were not supplied with the 
relevant content , and that Synthesis and Evaluation items were 
cast in a free-response format after we utterly failed to 
write them in the multiple-choice format. Second, the means 
reveal that collectively the science forms were more difficult 
than the social science forms. Third, student reactions 
about the difficulty of the Atomic Structure test caused us, 
as the reader will recall, never to administer it as the 
first one of the several forms which were to be administered. 



Consequently, the explanation of the reversal of 

^ — l/nw J, 2,0 CIO X uXXCWS • 

The principles, concepts, and generalisations which appear 
in (/ho sc^oxiCo forms, especially in the Atomic Structure form, 
were much more difficult t o grasp and use than were the same 
entities in the social science forms. This had the net effect 
of relatively decreasing performance on the Synthesis and 
Evaluation items, but the effect w’as somewhat cushioned on 
the Evaluation items because at least half of them required 
students to use external criteria in reaching an item response. 
We believe that these "external criteria" were largely "common 
sense," an attribute in which the students appeared not to 
be lacking. 
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This argument Is partially supported by the results 
of the simplex analyses which show that according to empir- 
ically determined complexity both Synthesis and Evaluation 
are placed between Knowledge and Comprehension at grade 
nine on. Atomic Structure; that Evaluation was placed between 
Knowledge and Comprehension at every grade level on the 
Glaciers form; and that all patterns on Lisbon Earthquake 
were as predicted. The argument is somewhat weakened because 
Synthesis was placed between Knowledge and Comprehension at 
grade nine and Synthesis and Evaluation were reversed at 
grade twelve on the Stages of Economic Growth fo]?m. 



Although it is rather late to suggest that we have 
qualms about the rationale for the hypothesis of decreasing 
me^ performance as process level increases, it seems appro- 
prlate Guttman’s contention that item complexity 

195*1 Independent attributes. (Outtman, 



entirely possible to make an addition 
test far more difficult than a subtraction test. 

For example, for a given population, select a 

missed 

et least 70^ of the population. The mean 
total score on such a test will then be less 

*®n subtraction items all of 
answered correctly by at least 70* of 

**'®“ **® ^®®®* 7. Hence the 

®*“* o« subtraction is greater than 
particular subtraction 
particular 

t®st . However, the Intercorrelation 
between these two tests can be precisely the 
s^e as for tests in which subtraction Is made 

addition. Furthermore, the 

can b^esSSMa?? ^®®*® ® simplex 

the same, no matter if orders 
Ox difficulty are reversed (p, 285 ), 

TP this SSm® ji . _ 

eraoirical f±nAinl7~\lZlA* '^*®"*«**a recently reporte( 

and difficultv were ur>T»Ai t^^ata, that complexity 

as desSd in “ hierarchical process( 

on the p^lcSlw"notloS'’t^«» hypothesis was based 

were hl?K"^aS.°uS toltiLnts ^5®Zt . 

were supplied with it prior to the all studeni 

to it during the test S.r. ®'*u®l acoesi 

» uuring cne cest, then knowledge of content would be a 
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constant factor over all levels of process with the consequence 
that Item difficulty would increase as complexity of items 
increased* With Just some exceptions, the pattern of means 
of support this rationale; however, the simplex data assail 
it because of the great frequency with which the most difficult 
tests. Synthesis and Evaluation, were placed according to 
complexity between Knowledge and Comprehension, The force of 
contradictory evidence is somewhat lessened due to the 
different item formats and hypothetical chance scores, but 
the point still stands. 

The results of the simplex analyses are somewhat 
contradictory, but they are regarded with some optimism. On 
one form they corroborated the imputed order of the taxonomy, 
and on the other three forms the predicted pattern occurred 
except for placement of Synthesis and Evaluation both of 
which consisted of questionable items. Although the hypothesis 
remains without verification, the results suggest that further 
work on item construction is needed before the hypothesis 

subjected to testing. However, that aspect 
of the Evaluation process which requires the use of external 
criteria might consistently lead to the misplacement of it 
unless some method is devised by which to make mastery of 
the external criteria a isommcn possession of all testees. 



B, Transcendence of Process 

It is claimed that the processes described in the 
^onomy are general over content. The response to a test 
Item is conceptualized as the interaction of content and 
process. When a student identifies the appropriate content, 
then he must use the relevant process to manipulate the con- 
tent to produce a response to the item. Accordingly, 
Application in mathematics. Application in science, and Appll- 
geo^aphy are identical with respect to process 
and differ only in the contents which are manipulated. 






that generality of process, it was hypothesized 

that data from taxonomy-type tests would have the following 
characteristics: (a) a factor analysis of the level scores 

four taxonomy-type tests will have the structure 
shown in the following scheme: 
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Factors 



Processes 

Knowledge 

Comprehension 

Analysis 

Application 

Synthesis 



I • II III 
X 

X X 
XXX 
XXX 
XXX 



IV V VI 



X 

X X 



Evaluation XXX XXX 

An ”X” Indicates the expected presence of Important factor 
loadings for a level score for each of the four tests. The 
hierarchical structure of the processes Is shown by the 
fact that after Knowledge each level score contains all the 
factors contained by the preceding level score plus one 
additional factor; and (b) the Intercorrelations of scores 
from the same subtest for different contents will have 
clrcumplex structure. 



P&Qyoy analysis . The scores from the taxonomy-type tests 
were factor analyzed. Each of the four forms contained six 
subtests, thereby yielding twenty-four process scores. A 
2 ^ X 24 matrix of Pearson product-moment coefficients, with 
unities In the principal diagonal, was analyzed by the 
principal axis method for each grade, nine through twelve. 
Twenty-four factors were extracted from each matrix. Although 
Kaiser’s rule Indicated that only four factors were present 
In each matrix, six were retained for Interpretation because 
that number had been hypothesized. 



Clrcump lex analysis According to Quttman’s clrcumplex theory, 
if a group of tests differ only in content, an Intercorrelation 
matrix derived from the scores will have two unique charac- 
teristics; the column totals will be equal and each row of 
the table will have the same entries as the preceding ■ row, 
but moved one space to th e right , and the end one moving to 
the beginning. 

Thirty correlation matrices were constructed, one for 
each process level for each grade and one for each level for 
all grades combined. Correlations were corrected for 
attenuation prior to the analysis. 
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Results 



Factor analysis e The usual methods of factor analysis prescribe 
a rotational procedure which seeks a s5jnple structure and. In 
the process, distributes the variance of a general factor over 
other factors. Because the notion of simple structure Is 
negated by the hypothesized factor structure for the cumula- 
tive hierarchy, the decision "fas made to attempt to Interpret 
the unrotated factor matrices. Although the Interpretation 
of unrotated matrices is not very desirable. It seems to be 
one of the few avenues of interpretation which was available. 

The major disadvantage in dealing with unrotated factors Is 
that all factors are bipolar except the first one. 



The unrotated factor matrices appear In Tables 22 
through 25 . 

To facilitate interpretation, a two-way table was 
constructed for factors II through VI (factor I is a general 
factor) for each grade level. The rows in the tables represent 
the four test forms, and the six columns represent the proc- 
esses. The cell entries are factor loadings. These appear 
as Tables 26 through 29. 

For each of the four grade levels, a general factor 
emerged. It accounted for 39?, ^9%, W and k3% of the 
variance for grades nine through twelve, respectively. For 
the ninth grade. Application for the form Stages of Economic 
Growth has no loading on the general factor. All other tests 
at all grade levels had high— or in a few cases, moderate — 
loadings on the general factor. 

When interpreting the factors, the pattern of signs 
and the magnitude of the }.oadlngs were taken into account. 

For a given factor. If all four measures for a certain process 
had non-zero loadings (approximately greater than .10 since 
the factors were unrotated) and were of the same sign, then 
that process was considered to be represented on that factor. 

In some Instances the process was identified as a factor when 
only three measures of it were like signed and had non-zero 
loadings; however, this was never done when the fourth measure 
had a moderate loading with a sign unlike the other three. 

In identifying a factor as being primarily related to a 
specific content the same criteria were adopted except that 
four of the six measures mro required to have like signs 
and non-zero content. 

In the matrices for all four grade levels some of the 
factors can be identified as process factors; i.e., the factor 
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Bifl?otet0d factor* Itiatrlx 
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FACTORS 



Tai?lable 


I 


II 


HI 


I? 


7 


VI 


Atoi&lc Struotxsre 














tr 

A 

G 

Ap 

An 

S 

£ 


697 

?06 

6?? 

586 

550 


180 

-085 

-H9 

-122 

302 

1)38 


26l 

-20U 

-363 

-320 

-222 


-335 

•^iil6 

-*3?2 

027 

-002 


-0ii3 

-11)1 

•122 

-X71) 

-092 

097 


-096 

130 

-025 

196 

—23.8 

—088 


Glaciers 














K 

C 

Ap 

An 

S 

£ 


689 

766 

757 

593 

527 

6ia 


183 

•»250 

—268 

-to 

-(E8 

386 


16o 

033 

037 

-002 

-228 

-105 


-163 

Oil 

026 

0l»9 

292 

000 


-023 

-OliS 

—019 

«007 

-170 

166 


-163 

-lliS 

-2U 

-596 

-396 

-032 


Lisbon Earthquake 














K 

0 

Ap 

An 

E 


650 

762 

776 

7lil 

725. 

529 


152 

-128 

-133 

-082 

189 

353 


hS5 

lia 

165 

Chi 

-066 

-153 


089 

196 

201 

206 

187 


-2W) 
-263 
-162 
-188 
-US 
— 160 


001) 

225 

157 

276 

O69 

233 


SconosBle Growth 














K 

0 

Ap 

An 

3 

S 


633 

790 

753 

6a 

633 

583 


231 

-20!) 

-180 

-31)9 

360 

1!|3 


4ll 

010 

078 

-092 

-221) 

—128 


-232 

028 

03U 

no 

169 

IQI 4 


269 

3^ 

3U 

317 

202 

327 


-006 

070 

056 

163 

-3j|^ 

237 





96 



XABSE 2k 
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TABLE 27 

Factor Loadings for 
Factors II through VI 
Grade 10 
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Factor Loadings for 
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TABLE 29 

Factor Loadings for 
Factors II through VI 
Grade 12 



Test Process Levels 



Form 


K 


C 


Ap 


An 


S 


E 


As 


-23 


+27 


+28 


+32 


-15 


-37 


G 


-21 


+20 


+24 


+30 


+13 


-43 


L 


-15 


+15 


+11 


+07 


-17 


-41 


EG 


-45 


+08 


+05 


+16 


-09 


-19 


As 


-02 


+36 


+31 


+42 


+34 


+26 


G 


-33 


-o8 


-10 


-08 


+12 


+11 


L 


-37 


-27 


-32 


-24 


+03 


+24 


EG 


-15 


-12 


-12 


-09 


+16 


+20 


As 


-09 


-16 


-14 


-17 


+13 


+25 


G 


-04 


+11 


+17 


+28 


+40 


+19 


L 


+04 


+15 


+20 


+17 


+16 


+i4 


EG 


-45 


-33 


-33 


-03 


-12 


-06 


As 


+3? 


+20 


+20 


-11 


+04 


-02 


G 


+34 


-17 


-17 


-19 


+13 


+01 


Xj 


• X 3 


+10 


+10 


+21 


+25 


-01 


EG 


-18 


+23 


+18 


+28 


+34 


+19 


As 


+03 


-03 


-03 


-05 


+14 


+38 


G 


+20 


-01 


-00 


+04 


+56 


-03 


L 


+01 


-17 


-18 
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loadings pervsde across the contents. At all grade levels 
at least one l.'actor of the six extracted is a content factor 
according to ';he criteria described above and in some in- 
stances mixed factors containing variance due to process 
and content were obtaiTied. 

At grade nine two factors, in addition to the general 
factor, were found to be primarily process factors. Two 
were mixed factors and one primarily involved content. Factor 

II is Knowledge and Evaluation vs Analysis, and Factor IV is 

Knowledge vs Synthesf.s and Evaluation. The mixed factors are 
as follows: III is '^valuation plus Atomic Structure and VI, 

Synthesis vs Economic Growth. Factor V is a Glaciers factor. 

At grade ten two process, one content, and two mixed 
factors emerged. Factor II is Knowledge, Synthesis, and 
Evaluation vs Comprehension, Application and Analysis. Factor 

III is Knowledge vr; Synthesis and Evaluation. The mixed 

factors are: IV Ifs Knowledge vs Synthesis and Lisbon vs 

Atomic Structure; arid VI is Synthesis and Glaciers. Tlxe 
content factor is number V which is defined by Economic 
Growth vs Lisbon. 

At grade <jleven three process factors, one content 
factor, and one mixed factor appeared. The process factors 
are as follows: factor II is Comprehension, Application and 

Analysis vs Synthesis and Evaluation; Factor 7.11 is Knowledge 
vs Evaluation; ard Factor IV is Knowledge vs Synthesis, The 
content factor Ij. V, Glaciers vs Lisbon and Economic Growth. 
The mixed factor Is VI, Synthesis vs Economic Growth. 

At grade twelve two process and three mixed factors 
emerged In addition to the general factor. Factor II is 
Knowledge and Evaluation vs Comprehension, Application, and 
Analysis. Factor V is a relatively pure Synthesis factor. 

The mixed factors are as follows: Factor III is Knowledge 

vs Synthesis and Evaluation plus specific content on Atomic 
Struccuj?e; Factor is Evaluation plus Lisbon vs Economic 
Growth, and Fac -i is Synthesis vs Lisbon, 



C3,rc^p lgx anals sis . Thirty correlation matrices wore 
constructed, one for each process level for e€ich gr€.de and 
one for each process for all grades combined, Thesc' matrices 
appe^ in Tableo 30 through 3^. VHiile none of these,* matrices 
can be classlfiod as a perfect clrcumplex in the sense that 
all column tota..s are exactly equal, many of them approach 
this state. As an aid in interpreting the goodness of fit 
of a matrix of JiJmilar process correlations to a perfect 
circumplex, the smallest column total was subtracted from 



the largest column total for each matrix and a distribution 
of these differences was made. This distribution was found 
to be highly positively skewed. It was estimated that a 
symmetrical distribution about the median would include a 
range of differences from about .01 to about .39, and that 
differences of .40 and beyond probably Indicate that the 
associated matrix is not a circumplex. For purposes of the 
present analysis then, matrices whose high-low column sum 
differences fall within the range of .01 to .39 are considered 
to be quasi-circumplexes . 

For grade nine, only the matrices for Knowledge and 
Evaluation can be considered as quasi-circumplexes. For grade 
ten all matrices satisfy the criterion for the quasl-circumplexo 
For grades eleven and twelve only the matrices for Synthesis 
fail to do so. All process matrices for all grades combined 
satisfy the quasl-circumplex criterion with the exception of 
Synthesis. These interpretations of the- circumplex analyses 
tend to support the theory underlying the taxonomy- type tests. 
However, it must be remembered that the cut off of .40 was 
established in a very arbitrary manner. Until either theoretical 
or empirical research concerning the true distribution of the 
high-low column sum differences is undertaken, these inter- 
pretations must be considered as highly tentative. 



Discussion 

The hypothesis tested by the factor analyses of the 
taxonomy-type tests and the circumplex analyses was that of 
transcendence of process. More specifically a hierarchical 
structure of the processes was postulated and it was predicted 
that the Intercorrelations of scores from the subtests across 
forms would form a circumplex or quasl-circumplex. 

The factor analyses offer some support for the 
hypothesis. Of the non-general factors, several at each 
grade level give an indication of being more highly determined 
by the processes than by the contents; moreover, a fairly 
high degree of consistency exists over grade levels with 
regard to the nature of the process factors. The following 
Informal equations show the patterns of process loadings on 
factors over the grade levels. 

^9,11 * K — Ap + E 

^10,11 *K-C-An-Ap+S+E (reflected) 

^11,11 * -C - An - Ap + S + E 

^12,11 “K-C-An-Ap+E (reflected) 
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CorrelitloQS ^thin Le7els Across Forms 
Grade 10 
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I»68 




585 


Ii92 


S3 


632 


585 




692 


Si. 


530 


Il92 


692 





1.630 1.SI1S 1.909 1.711» 



°1 °2 ®3 



"l 




791 


723 


751 


°2 


791 




829 


858 


®3 


723 


829 




751( 


Sll 


7^ 


858 


751( 






2.265 2.1(78 2.306 2.363 






Anj 


An^ 


Anjj 


Att^ 




51(8 


616 


62l( 


AH2 


51^8 




650 


732 


An^ 


616 


650 




727 


An* 


62k 


.732 


727 






1.788 1.930 1.993 2.083 




E 

O. 


®2 


E3 








63U 


U63 




®2 


63U 




527 


9PH — ^ 


E3 


ii63 


527 




1|32 


% 




565 


1(32 





1.5:52 1.726 1.1^2 1.U52 
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•awi 32 

I 

Corr^tioD8 WLthla Lmls Across Forts 
OandQ 11 







h 


'3 


■'i* 




Cl 


®2 


03 


Cl* 






679 


628 


681* 


®1 




829 


728 


575 


'2 


619 




657 


651* 


Cg 


829 




806 


872 


'3 


628 


657 




681* 


“3 


728 


806 




833 


h 


68t» 


6SU 


68!t 




% 


575 


872 


833 






1.991 


1.990 


1.969 


2.022 


2032 


2.507 


2.367 


2,280 




*% 


^9 


Apj 


*■Pl^ 






JU 12 


A113 


Ani* 






75? 


726 


5k> 


An^ 




653 


693* 


7a 


APg 


75? 




831* 


81(1 


tog 


653 




713 


737 


iP3 


726 


83Jt 




852 


toj 


691 * 


713 




756 


AP1» 


810 


8ia 


852 




to), 


7a 


737 


756 






2.293 


2.ii32 


2.1*12 


2.503 




2.098 


2.103 


2a63 


2.21*1* 




h 


®!i 








% 




®3 


\ 








712 


SUi 


% 




610 


535 


1*59 


®2 


t|62 




$27 


379 


% 


610 




617 


561 


33 


712 


527 




773 


®3 


535 


617 




579 


SJ, 


situ 


379 


TB 






1*59 


561 


5?9 






1.718 


1.368 


2.012 


1.696 




I. 60 I* 


1.788 


1.731 


1.599 



t 

I 



1 

] : 
1 . 

.1 ' 

1 

'] 










1 



’•'k 



' - 



r 






IJ; 






K" 



I 

I 



II 

1 0 
0 
il 
0 
0 
iJ 



ill 



o 

ERIC 
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TABLE 33 

Correlations Within Levels Across Forms 
Grade 12 



K 


h 


K2 


% 






^1 




°3 


°4 


% 




615 


59k 


S7k 


°1 




753 


668 


719 


h 


6lS 




706 


598 


C2 


753 




795 


767 


h 


S9h 


706 




k73 


°3 


668 


795 




' 749 


h 


S7U 


598 


h?3 




<=k 


719 


767 


749 





1.783 1.919 1.773 1.6!i5 



500 !05 660 
1.508 i.29h 1.777 1.575 



2olh0 2.315 2.212 2.235 





Api 


AP2 


AP3 Ap|^ 




An^ 


Att2 


An^ 


Anj, 


APi 




793 


642 708 






661 


590 


737 


AP2 


793 




772 702 


Ang 


661 




723 


681 


AP3 


6it2 


772 


698 


Ail^ 


590 


723 




804 


APii 


708 


702 


698 


Anj, 


737 


681 


804 






2.143 2c263 2.112 2.108 




1.988 2,065 2.U7 


2„222 






Sg 


S~ S' 

3 4 




^1 


Eg 


51^ 


% 




385 


623 500 






525 


482 


488 


$2 


385 




494 415 


Eg 


525 




576 


531 


^3 


623 


494 


660 


E3 


4S2 


576 




486 



E, 



’^88 531 li86 

l<.li95 1.632 l.5i4i 1.505 
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IABZ£ 3^ I 

Correlations Wi'^n Levels Across forms 

1 



All Grades 





h 


K2 


"3 


"4 


Kl 




705 


667 


689 


Kg 


705 




767 


726 


K3 


667 


767 




629 


\ 


689 


726 


629 






2.051 


2.198 


2.063 


2.044 




kpi 


Apj 


AP3 


AP4 


Apj 




751; 


8.43 


737 


APg 


751; 




848 


803 




81i3 


81;8 




822 


APj, 


737 


803 


822 






2.331; 


2.405 


2.413 


2.362 




Si 


S2 


S3 


S4 


Si 




451 


672 


547 


Sa 


li 5 L 




548 


443 


®3 


672 


543 




773 


El* 


547 


443 


773 






1.670 


1.442 


1.993 


1.763 



ERIC 





=1 


^2 


^3 


<=i* 






734 


7?6 


778 




781* 




826 


858 




71^ 


826 




801* 


% 


GO 


852 


804 






GO 

• 

CM 


Jc462 J 


>.336 J 


!.l)3l* 






An» 


An^ 


Aaj, 






624 


62? 


708 


An* 

2 


624 




708 


728 


An- 


627 


708 




785 



PxL 702 728 785 

4 

1,953 2.060 2.120 2.215 






% 


Eg 










592 


512 


488 


®8 


592 




5’.7 


559 




512 


5?7 


\ 


520 




1*88 


559 


520 





1.592 1.728 1.609 l.?67 



In each of these factors two or more of the subtests. 
Knowledge, Synthesis, and Evaluation are always in opposition 
to Comprehension, Application or Analysis. ^ 

stated 

^9, IV ® K - S - E (reflected) 

^10,111 * K - S - E 
^11,111 “ K - E 

^12,111 = K - S - E (reflected) 

At all grade levels, factors involving onlv Svnthesia 
were present and for grades nine, ten, and twelve a ^aSof 
involving only Evaluation was foiid. a .actor 

thafr these factors were mixed in the sense 

in the^f ae' or^in alwaiys involved 

in Tine lact-or in addition to tne process. The presence of 

e?is® factors tends to discredit the hypoth- 

izatlon of aix item response as an interaction of content and 

the anSysef to 

c-ariiy the nature of these mixed factors. 

extent hypothesis is supported to some 

extent by the oirer.-<plex analyses but convincinp- evidence 

cannot be provided by this technique because thi probSilitv 

tS^ 

‘before this 

the .^actors of^ 

buf ?L^Lpo?L®?o™ ff tL^stosSBHF f 

by inspecting patterns of means SrthrslS?c=f^t *^°"® 

approi 
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(a) A bl-factor solution (Harman^ i960) enables 
grouping variables according to a hypothesized design. The 
factor analysis allows the design to be tested by giving 
evidence of the adequacy of the hypothesized grouping. This 
technique was not used because computer programs were not 
available and the analysis of four 2i( x 24 iatrlces woSld be 
too time consuming to accomplish by hand. 

(b) The square root method of factc’^ analysis would 
be particularly appropriate because the resulting factor 
matrix Is triangular In form as is the hypothesized hierarchical 
structure. This method, however, is especially sensitive to 
the communallty estimates one uses and will break down if the 
Gramian qualities of the matrix are not preserved by the 
communalities . Nevertheless this method should probably be 
attempted in future analyses., 

(c) The presence of content factors in the taxonomy- 
type tests might obscure the results of either of these 
suggested methods. A third method would be to retain the 
principal factor solution and to attempt to rotate it to a 
hypothesized solution which would take into account both the 

factors. An approach of this kind might 
employ the 'pattern quartimax” technique which was developed 

by vl960) or by the "Procrustes” method proposed by 

Hurley and Cattell (1962). uy 

C. Psychological Structure 

soal whi<3h guided the taxonomists was to produce 
5 1 scheme which would be psychologically meanlng- 

sec'c-irn piosents the procedures and results of 

studies designed to reveal the psychological structure of the 
cognitive processes. unc 



Proee dure 

/•.V sweral major objectives were set for these studies: 
(a) to determine the cognitive aptitudes, as defined by KIT 
tests, and their regression weights which are related to 
taxonomy level scores; (b) to determine the changes in regres- 
sion equations for each level, for all contents, for each 

de ..ermine the similarity of equations for the 
,ame -.e\el for each content, but calculated on different 
grade-groups; and (cl) to examine the eq^iations for each 
taxonomy level, consider(?d over all contents and grade-groups. 

.xP 4.V. ^5®®® objectives should reveal the structure 

of the taxonomy as defined by more elemental cognitive apti- 
tuaes, whether aptitudes transcend content, whether tL 



U-- — 



psychological structure of the taxonomy is a function of 
grade-level, and whether systematic changes occur from level 
to level in the regi*ession equations. 

The following sections deal with the procedures used 
to develop cognitive factor scores for use in the regression 
analysis • 



Obtaining factor scores . Thirty-seven cognitive factor tests 
from KIT were administered to students from grades nine through 
twelve. A listing of these tests and the factors they purport 
to measure appears in Table 35. The aptitude tests were 
chosen to provide measures of sixteen cognitive factors which 
were believed to be related to the processes measured by the 
taxonomy-type tests. The scores from one aptitude test for 
grade nine students were judged to be invalid so they were 
discarded. 

For twenty-four of the tests, scores were available 
for Part I and Part II. In each such case. Part I - Part II 
correlations were computed to yield an alternate forms reli- 
ability estimate. Because total scores were to be used in 
the analyses, these coefficients were used to estimate total 
test reliability by means of the Spearman-Brown prophecy 
formula. The obtained reliability coefficient? appear in 
Table 36 . 

For each grade separately, the reference variables 
were int ere or related by means of a missing point program to 
maximize the niimber of students contributing to each coeffi- 
cient. The minimum number contributing to any coefficient 
was more than 200 and the majority of coefficients vfere 
based on more than 250 students. ^ 

Each correlation matrix was then factor analyzed by 
the principle axis method, using squared multiple corre- 
lation coefficients as communality estimates. Rotational 
solutions were imposed on the factor matrix by the varimax 
method . 



It was presumed that the rotation would yield sixteen 
common factors because the KIT battery contained tests pur- 
ported to measure that many psychologically pure factors. 
However, the rotation yielded a large number of specific 
factors so the sixteen-factor solution was abandoned. A 
ten- factor rotation solution for the twelfth-grade data was 
satisfactory because it contained no specific factors. On 
this basis, a ten-factor solution was regarded as appropriate 
for describing the aptitude data from all other grade levels. 



TABLE 35 



Cf-1 

Cf-2 

Cf-3 

C8-1 

Cs-2 

Fa-1 

Pa-3 

Pe-2 

Pe-3 

Fi-1 

Pi-3 

I-l 

1-2 

1-3 

Le-1 

Le-2 

Le-3 



Kit of Reference Tests Administered 
and Factors Identification 



Test Name 



Factors 



Hidden Figures Test 
Hidden Patterns Test 
Copying Test 
Gestalt Completion Test 
Concealed Words Test 
Controlled Associations Test 
Associations IV 
Simile Interpretations 
Word Arrangements 
Topics Test 
Thing Categories Test 
Letter Sets Test 
Locations Test 
Figure Classificaticsn 
Estimation of Length Test 
Shortest Hoad Test 
Nearer Point Test 



Flexibility of Closure 

« n II 

•• II ft 

Speed of Closure 

«• II It 

Associational Fluency 

It II 

Expressional Fluency 

II It 

Ideational Fluency 

IS II 

Induction 

tf 

II 

Length of Estimation 

II II II 

II II II 



Ma-1 Picture-Number Test 
Ma-3 First and Last Names Test 
N-1 Addition Test 
N-2 Division Test 

N-3 Subtraction and Multiplication Test 

0-1 *Plot Titles 

0-2 Syiobol Production 

R-3 Ship Destination Test 

R-4 Necessary Arithmetic Operations 

Re-1 Gestalt Transformation 

Re-2 Object Synthesis 

Rs-1 Nonsense Syllogisms Test 

Rs-2 Logical Reasoning Test 

Rs-3 Inference Test 

Sep»l Apparatus Test 

Sep-2 Seeing Problems 

V-1 Vocabulary 

V-3 Wide Range Vocabulary Test 

Xa-1 Match Problems II 

Xa-3 Planning Air Manuevers 



Associative Memory 

II II 

Number Facility 

n II 

II II 

Originality 

ft 

General Reasoning 

« II 

Semantic Redefinition 

II II 

Syllogistic Reasoning 

II II 

n M 

Sensitivity to Problems 

II II It 

Verbal Comprehension 

^ tl 

Figural Adaptive Flexibility 



* Scores on this test were judged invalid for grade nine. 
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TABLE 36 

Reliability Estimates for Twenty- four 
KIT of Reference Tests 



Test 


Sample 


Code* 


Size 


Cf-1 


1107 


Cf-3 


1098 


Cs-1 


1128 


Cs-2 


1110 


Pe-2 


1102 


Pe-3 


1047 


Pi-1 


1098 


Pi-3 


1052 


1-2 


1042 


1-3 


1094 


Le-2 


1104 


Le-3 


1124 


Ma-1 


1048 


Ma— 3 


1095 


N-1 


1098 


N-2 


1100 


N-3 


1096 


0-2 


1076 


R--2 


1090 


Rs-1 


1062 


Sep-2 


1074 


Xa-1 


1073 


Xa-3 


1073 


Xs-3 


1071 


♦Test 


code symbols 



Reliability 
Estitoate 
(Part I-Part II) 

.780 

.742 

.750 

.667 

.202 

.489 

.745 

.401 

.476 

.128 

.439 

.569 

.534 

.719 

.808 

.795 

.831 

.655 

.616 

.211 

.497 

.651 

.328 

.224 



Reliability 
Estimate 
(Total Test) 

.876 

.852 

.867 

.800 

.337 

.657 

.854 

.573 

.645 

.226 

.610 

.725 

.696 

.836 

.894 

.886 

.908 

.791 

.348 

.664 

.788 

.494 

.366 



JimmMm 



^ ^ Factor scores were computed through a linear reereas'lon 

estimated by common-factor score for subject f was 



*'lj ■ ®JiZj 2212 + •••• + BjnZin “ M 
where d - 1, 2, 3, ... n 



«« 4.U 3 ... n are the obtained scores 

on the n tests, expressed In standardized score form. The 

beta weights and are determined by mlnlmlzlnis 

tSie hypothetical 

-2 * estimate, f,,. This solution Is s 

fHfiShah ®ioln?^ square multlHe regression equation 

hco™ffo”e2k sSdech!°‘^'^“® ^ *®“ 



Regression analyses . Distributions of factor scores and 
taxonomy test scores were transformed so that each would havp 
a mean of 50 and a standard deviation of lo7 BecL« hte 
regression analyses required complete data for each sublect 

assigned to each missing data point. Each 
set of factor scores was used to predict the performance of 
students on each of the six subtests of each of the taynnoniv 

ha™"srade“lever*'^ThH analyses were computed for 

hrstSdtrd'melhods?® regression equations were deveioped 



Results 



Because the an^v^es fo^^oi? ^^®.P^®sence of ten common factors, 

as“pos8ihle,“;hl«thrs w“e®ex?rlctS%h? ®®»Parable 

The unrotat^d factor mahrlcef lUlTlt Tawlh 3? 

41)* ”Tables*45'^throuvh*?i'**^°”* appear in Tables 41 through * 

o-belhh^la^e' 

ioadlr|riorihf'‘re^;htag factors to gS%”h^oSgf?2?‘'® 

IK kSsH 



I 

I 

I 

I 



I 



1 

I 

I 



o 

A* 
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of each of these factors is not precisely the same at an 
grade levels but it is sufficiently simiLr Iror^rlL to 

fpveic*° regarding each as oonmon to all fraL * 

levels. We do not believe that igno‘»'ine the sllffhf* 

in invalid- 

^6). a„d”l^eenrciosLf ($aw 

III th^^ t%l?ri^SLJSted 

factor ZlZ^tl ll\lZllZlnT^ 

tl"t:stft'Li°""ir*d <=he"pSesencf'l^"fhll fStor 

?e‘S^ 

all grades firmly -estLlL'^itfvrrbarmLe!®* 

InSnitlS “1^ it 

ifcy. ^d one. measure If f!^JS*|da^t?ve ?!lxmilfv°'’"fn"®"‘ 

addition, at trrade twelve an ^ J-exiDiiity, In 

S1JS,SSS”f.SS '"’' 

S;l 

51a) for^gradertln/Sn^^ ^’’^tle 

Associations IV (Pa-^^ Thiifl. defined by 

Transformations (Re- 1 )* This ^^1-3), Gestalt 

grade nine. ^acoor aoes not appear at 

The factors which are common for* «n n>yto< 4 A i t 
have been described above. The remaining dLlrfptllSl?e 

\ 



iilt^ 
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by grade level and deal with factors which emerged buf 
not conmon over all grades. Some are snecifirfo cSoL ? , 

some az>e unidentifiable, and some appeal at tuo 



ii^'are®nol 

ing appear In elch fHellnrS" tl 

tests each of which hav^t amai? penned by three 

cannot be interpreted so It wtto^not^nnm. L^ ° ^o’ 4.®*® 

Factor IX are specinc The 

been named accordl^^to^the*KIT^ma^^ 5 ^ese factors have 

Flgural AdaptlvrPlfxibllltv rv®?*®'’ 

Reasoning. ''^ei.iDnity and Factor IX Is named Sylloglstl 



are not common over^gradef" Factor ®*’®'^® *^®" 

Redefinition. It Is aSoft sneM?L^ "®"®^ Semantic 
large loading for Object Synthesls^fRl **®® ®"^^ °"® 

for Logical Reasoning (Rs-2) ?*“* ®“® log'll' 

Reasoning. All tto^ tests "®“«^ Deductive 

on it involve reasoning; SMp loadings 

(Rs- 3 ) appear on reasoning factor* (R~ 3 ) and Inferencei 
Hidden Figures (Cf-l) S^ls8oo&^i4?v‘'®*‘ ®*"^^®® *«<* 
in several other facLrl ^Hbif s?udy! '■®®®®”^"8 variables 



eleven are hot common^for all^grades ^“ctors for grade 
Deductive Reasoning. It ifLtt k„ f®®*®'' 1* »a«>ed 

reasoning from geiwral principle *’e<l«ire 

ucts. The factor is named Bediotive specific prod- 

loadings of two tests which are dw-»®®5®"^“® despite the 
Plot Titles (0-2) and Planri^*»?-'^u^®®"^ Production In natu 
X is named Sensitl“?y t^^flems "®?r!®” PactS 

primarily defined by the Appa^alSs'test (Sep-?)?”^*’' 



twelve are not common^overall g^adL* V*?*®*^^ 
Syllogistic Reasoning. Factor ViT^fo’ f®®*°** ^ !» named 
tlfled. It is a bipliar faetL "®®«^ ““S’ “«»- 

factors IS highly unusual in the"Salys%rSnmftf tists. 

polntlngf%^*‘Slrel^®-|,-^^^^^^ 




1 



I 



I 



I 



I 



I 



‘ i: 



: \: 



r 

'¥ 
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would be common for all grades. Instead only sis common 
factors emerged and two others emerged for three of the 
four grade levels. Furthermore, the component; ”o<'^eaeh 
factor a^e not identical at each grade level but' thef 
are sufficiently similar to warrant glvln^them a comon 

levir^?hls^ Sf ^!i<=toi-s Ire IpecifnS 

graae level. These discrepancies from our exDectanf®v 

interpretation of III regression 
analyses because of the differences between factors at 
several grade levels. These dlscreplniiefair 
undoubtedly attributable to any one or more'of the foiio„in» 
factor differentiation within thrstSLn?rwis dim^enr ® 

- -s: Si- 



Reg ression analyses . For each grade level twp«i-xr f^nr» 

Kie^srihroSih 5^ 5rficmta?e®fV‘’“^‘^JT 

significant predictors for eaS process 

coS“e^|^ifIf ®"^“sed according to 



Of the tSonomy-t^e^Lti Sed^ihe”®^ *’’® ^^lyses 

factors. Tberefnnr i^e presence of content 

slgnlfloant\eta coefflclents^S^indice®? "*’®" i“t®'^’^eting 
process relationship Inasmuch ll 

because of the particular demands'oflif cSnlenfunSr way. 



in severS\iysi“com^iLns®irf men 
(a) by grade and form* (h^ hfr process scores 

over grades and (d) over^graLs and fo™e^°T® 

based on the results of Any conclusions 

quite tpyf.ah<voi';;~K::';. — sum maries must be hel d 

factors for dlfferpn<- »T.af<pn .^°BE°nents of similarly named 

— eren t_gradeg_^ s not nec^sgS^i y identlcal - 



some of the^comp^ie^i’^^where^M ®5uatlons are used for 
components appear aHte c^lfo? co^nuLf aM???' f . 
according to the code which appearrS Table ^ 



■ ' 



TABIB 3^ 

Unpobatod Factor Ifetrlx 



Kit cf Reference Tests 
Grade jf 
FACTORS 



Variable 


I 


n 


Cf 1 




068 


Cf 2 


-513 


no 


Cf 3 


-588 


150 


Cs 1 


-176 


061 


Cs 2 


-38? 


-0L6 


Fa 1 


-575 


•“ 0 l *5 


Fa 3 


-U31 


-159 


Fe 2 


-5l5 


-051 


Fe 3 


—562 


-021 


Fi 1 


-1(87 


-121* 


Fi 3 


-386 


-057 


1 1 


-591 


— Ql *9 


X 2 


-51.3 


231 


I 3 


-383 


071 * 


Le 1 


-31.8 


172 


Le 2 


-l.ca 


189 


3 


-398 


152 


Ka 1 


-276 


-l*Ol!* 


Ka 3 


-1.25 


-1*15 


N 1 


-51.5 


- 51 } 1 * 


N 2 


-573 


-1*98 


N 3 


-1.50 


-576 


0 2 


-632 


06? 


R 3 


-506 


1*29 


R k 


-1.71 


n 9 


Re 1 


-3& 


357 


Re 2 


-32? 


11*8 


Bs 1 


-U |2 


022 


Rs 2 


“58l 


11*1* 


Rs 3 


-595 


235 




-332 


-131 


Sep2 


-385 


— Ol*l* 


V 1 


-616 


019 


7 3 


-31.5 


058 


Xa 1 


-352 


222 


Xa 3 




327 



m 


IF 


7 


VI 


-183 


-051 


-132 


106 


-381 


033 


116 


05i 


-1*07 


068 


193 


082 


-300 


059 


-kt6 


-278 


-329 


070 


-toi 


-002 


225 


-01*2 


-0.9 


-179 


167 


-01*1 


223 


-005 


11*0 


-299 


-QSl 


-017 


071* 


—221 


—065 


212 


071* 


-327 


033 


-001 


-036 


-32l* 


-161. 


-156 


Oil! 


-0(39 


—023 


-131 


076 


233 


-052 


058 


-081* 


-157 


022 


075 


-231 


-QS'6 


120 


«037 


-326 


06l 


023 


—086 


-176 


233 


073 


-Id* 


-128 


158 


-266 


317 


107 


175 


-196 


230 


-099 


109 


261* 


-265 


—lOl* 


ns 


072 


007 


—069 


099 


231* 


«226 


010 


-176 


055 


Id* 


187 


095 


100 


025 


137 


21*8 


0I|2 


-121* 


001 


007 


-120 


-a6 


-167 


-353 


-Id 


-176 


161* 


065 


037 


—168 


249 


277 


‘022 


oli5 


35? 


127 


086 


-038 


000 


-1*35 


163 


079 


C65 


-009 


Id* 


066 


31*8 


-007 


-106 


-d*7 


289 


-005 


-035 


025 


—285 


on 


235 


191* 


-013 






ne 



vn 7m 3 x X 

160 062 237 -021; 
Olj^ 036 036 250 

-111 -057 -002 103 

081 i -132 -100 -075 

019 -153 -OOU -031* 

-195 032 101* -109 

-075 -025 -063 Oil* 

-196 Olil 117 070 

-006 -217 01*6 001* 

057 -030 -185 063 

-177 no -0*9 072 

-Ol|l -208 01*7 -080 

023 -037 -Hii* -008 

Ola -€S;6 198 -003 

-012 ll|l* 2l*l* -13U 

-265 071* -055 -025 

-156 -C18 201 -078 

061* 222 -019 -91 
-008 126 010 -103 

11? 0D9 -028 012 

051 -003 013 01*9 

173 -1^ 01*0 Oil* 

-061 -181 01*5 -131 

11*9 086 033 -027 

-000 185 003 -061* 

159 06l 01*8 080 

255 170 -01*2 -033 

-069 -131* 200 12k 

-073 -081 -020 098 

Q5i* -033 -061 -01*1* 

032 033 -181* -01*6 

108 01*2 -031 -272 
-OU* 115 006 061* 

052 109 -085 176 

-028 102 -122 -060 

295 -160 -031 101* 



119 



TABLE 38 



1 

1 



r 

I 



Uni'ot&ted Factor Ifetrix 
Kit of Refersnce Tests 
Grade 10 
FACTORS 






» 




I 

t 



Variable 

Cf 1 
Cf 2 

Cf 3 
Cs 1 
Cs 2 
Fa 1 
Fa 3 
Fe 2 
Fe 3 
Fi 1 
Fi 3 
I 1 
I 2 
I 3 
Le : 
Le 2 
Le 3 
1 

m 3 
N 1 
N 2 
N 3 
0 1 
0 2 
R 3 
R li 
Re 1 
Re 2 
Rs 1 
Rs 2 
Rs 3 
Sepl 
Sep2 

V 1 

V 3 
Xa 1 
Xa 3 



1 n ni IV V 



n VII vin IX X 



c388 

-feli 

-287 

*^3^2 

-562 

"*36l 

-^1 

-353 

-lt20 

e»62lt 

-526 

-367 

-391 

-li68 

-li68 

-233 

-h77 

-1j37 

—51^0 

-iiii 

-l!;2 

-ii67 

-5fi6 

-675 

-1^78 

-392 

-259 

'•66li. 

— l{.6o 
269 
-l4l8 
607 
-593 
-it96 
-222 



-3l|2 

181 

-283 

-113 

OLO 

116 

-185 

21.8 

165 

038 

025 

Oil 

-102 

-Ihh 

128 

-199 

-153 

188 

361 

637 

572 

720 

OL2 

-156 

-369 

Uh 

-313 

-227 

-no 

-061 

-173 

089 

060 

Oli; 

-055 

-223 



-170 


295 


-006 


263 


C60 


362 


276 


21*3 


01*6 


231 


01*9 


-121* 


271 


-125 


151* 


-068 


112 


-209 


500 


-072 


503 


-000 


001* 


099 


-095 


132 


026 


065 


-n6 


071* 


021* 


181 


-090 


035 


-133 


01*9 


-106 


-082 


-067 


311* 


-161* 


125 


020 


19li 


1*76 


-012 


11*3 


-100 


-257 


-066 


-181 


•»i5o 


-089 


-120 


1*71* 


08? 


-066 


— ll*X 


-123 


-136 


-392 


-021 


1*01 


-215 


058 


-293 


-201 


-387 


-191* 


-231* 


-Oil* 


108 


«-i02 


081 



065 


072 


290 


-103 


n6 


169 


-168 


023 


035 


296 


-112 


009 


273 


’«l8l 


•«110 


-008 


idi* 


-109 


-088 


150 


163 


0*098 


-073 


11*5 


003 


-01*2 


091* 


-038 


01*8 


171 


-01*5 


-211 


029 


180 


-015 


230 


-168 


-01*3 


133 


015 


171 


-na 


187 


-11*3 


-237 


-057 


056 


025 


-192 


-la 


-026 


032 


-236 


-067 


-091 


-ool* 


21? 


110 


— 060 


-0l*l* 


035 


n? 


-038 


-067 


-083 


c^9 


— 165 


157 


115 


258 


307 


255 


— 03I* 


077 


ao 


377 


008 


-030 


-059 


-106 


-085 


-151 


-052 


-075 


-023 


-119 


Oil* 


— 176 


-027 


185 


101 ' 


035 


109 


093 


-037 


-037 


-029 


-117 


21*2 


-156 


-076 


-125 


01*1* 


018 


259 


-ni* 


-052 


-015 


055 


-laa 


023 


151 


-101 


-008 


-329 


—100 


-211 


—226 


-09? 


151* 


01*7 


-061* 


366 


-166 


-281 


26? 


036 


-11*7 


035 


205 


-007 


-059 


203 


087 


-110 


-139 


I61 


-XO9 


-113 


059 


•^85 


097 


-035 


-013 


-323 


06? 


-032 


-ool* 



000 003 

-lli2 -053 

Oil* -0li9 
055 370 

193 106 

090 130 

-161* 03 h 

10 k 017 

107 091 

051 -01*6 

-236 056 

-032 202 

o51j 096 

-028 -021* 
177 -138 

-01*8 -15’* 
085 001* 

-231* -057 
029 -055 
-068 -058 
-099 -O9I* 

035 -01*8 
159 067 

139 -181* 

108 -03I* 

-059 166 

-252 -075 
n9 -307 
-037 -059 
-016 -088 
220 CI9 
120 -012 
-090 -029 
-01*5 038 

002 020 
-ii*5 Ola 
— 026 0^ 



1 






I 



I 

i 

1 

1 

1 

{ 



I 

I 



I 



I \ 



TABLE 39 

Unrotated Factor Matrix 
Kit of Reference Tests 
Grade 11 



FACl'ORS 



Variafele 


I 


II 


ni 


IV 


Cf 


1 


-594 


-101 


-os:4 


-007 


Cf 


2 


-600 


-200 


-172 


-214 


Cf 


3 


-6l<6 


-316 


-201 


-064 


Cs 


1 


-238 


-306 


-350 


-575 


Cs 


r\ 

CL 


-442 


-138 


-315 


-477 


Fa 


1 


- 5^3 


117 


-ocii 


081 


Fa 


3 


-574 


120 


- 11:16 


% 

0 

1 


Fe 


2 


-277 


074 


1«3 


150 


Fe 


3 


“482 


211 


- 1 C 6 


159 


Fi 


1 


-513 


082 


-335 


311 


Fi 


3 


-540 


113 


-271 


.:4o 


I 


1 


-605 


022 


036 


-181 


I 


2 


-428 


-162 


208 


l4i 


I 


3 


-4^ 


-266 


-O61 


156 


Le 


X 


-388 


-175 


-194 


-124 


Le 


2 


-490 


-234 


-137 


-030 


Ii6 


3 


-409 


-192 


-006 


-010 


Ma 


1 


..443 


330 


-078 


-030 


Ma 


r% 


-425 


457 


-065 


014 


K 


1 


-464 


538 


028 


-343 


N 


2 


-S17 


399 


208 


-261 


N 


3 


-475 


602 


•C 04 


-188 


0 


1 


-255 


-004 


-128 


259 


0 


2 


-599 


-185 


-lU 


104 


R 


3 


-5^ 


-275 


308 


-017 


E 


4 


-673 


004 


198 


-111 


Re 


1 


-524 


-158 


U4 


037 


Re 


2 


-331 


-123 


-359 


155 


Rs 


1 


-184 


-085 


295 


-121 


Rs 


2 


-596 


-028 


327 


047 


Rs 


3 


-60B 


020 


4o6 


077 


1 


-236 


219 


-319 


469 


2 


-‘*484 - 


021 


-016 


163 


V 


1 


-554 


057 


279 


172 


V 


3 


-526 


026 


385 


0S3 


Xa 


1 


-483 


-250 


075 


096 


Xa 


3 


-273 


-360 


263 


077 



V 


VI 


VII 


VIII 


IX 


X 


-107 


-U8 


046 


077 


177 


103 


-183 


-102 


207 


-308 


175 


143 


-319 


-083 


-066 


«127 


053 


-054 


259 


222 


058 


- 0 .l 4 


-104 


-085 


351 


033 


0ii6 


012 


-157 


-100 


332 


-U 9 


-031 


•OC2 


-Oil 


167 


457 


-0li6 


050 


167 


208 


-007 


-072 


166 


163 


130 


-191 


019 


- 0 C 2 


091 


133 


“073 


-U 6 


122 


-OCX 


186 


-172 


-087 


-165 


046 


247 


032 


-148 


-039 


-030 


-as 


034 


028 


263 


096 


064 


-160 


043 


090 


234 


103 


-037 


092 


009 


150 


-137 


154 


-056 


-163 


-329 


-131 


049 


018 


006 


-105 


-274 


-133 


-179 


-023 


023 


001 


-260 


-051 


-050 


-l 40 


-238 


135 


-O95 


-346 


204 


038 


147 


008 


-032 


-220 


302 


051 


-155 


-132 


-195 


155 


-181 


-025 


0 X 0 


-015 


-131 


009 


-247 


030 


-006 


026 


-223 


256 


-050 


-058 


U 8 


036 


“014 


475 


170 


004 


a 9 


oa 


-039 


-086 


-076 


-091 


-039 


-137 


-047 


066 


-067 


113 


-048 


059 


-039 


- 0 l 6 


-032 


301 


-C?89 


104 


180 


-189 


-260 


157 


217 


120 


136 


-074 


-050 


098 


098 


-on 


128 


243 


-030 


-102 


199 


-055 


-071 


058 


019 


140 


-167 


039 


079 


-046 


-04o 


067 


-012 


-185 


"I28 


-016 


-l 4 o 


037 


086 


-320 


021 


137 


117 


-154 


-010 


017 


330 


- 144 . 


050 


-273 


-no 


- 0?8 


214 


-057 


-048 


-305 


-032 


- 1<3 


-173 


031 


148 


171 


-034 


019 


-082 


200 


048 


-120 


125 


-04d 



TABIE 



Unrotated Ffictcjr Matrix 
KIT Cf fieference Testa 
Grade 12 



P.'XJTCRS 



Variable 


I 


n 


m 


IV 


V 


VI 


vn 


vm 


u 


X 


Of 1 


^9h 


038 


009 


216 


-oa 


-023 


-213 


-102 


-091 


-070 


Cf 2 


0S2 


-0li3 


032 


335 


-033 


064 


022 


-219 


-132 


109 


Cf 3 


068 


033 


07lt 


326 


«163 


084 


-034 


...069 


-134 


063 


Cs 1 


2!i6 


oliii 


571 


181 


062 


-192 


303 


233 


-on 


d 3 


. Cs 2 


39U 


03U 


580 


192 


073 


-007 


071 


019 


-007 


061 


Fa 1 


1^86 


033 


110 


-306 


097 


023 


Id 


006 


-138 


-123 


Fa 3 


liX7 


-083 


498 


-253 


080 


096 


-083 


-173 


089 


-Id 


Fe 2 


321 


001 


-169 


-145 


-134 


023 


180 


033 


-093 


-053 


Fe 3 


303 


131 


-216 


-184 


-032 


-093 


218 


-105 


008 


no 


Fi 1 


371 


037 


-128 


-269 


-336 


148 


039 


078 


088 


198 


Fi 3 


503 


038 


342 


-195 


-161 


-020 


-114 


:i44 


-164 


090 


I 1 


620 


029 


-003 


152 


-006 


020 


107 


-130 


039 


-147 


I 2 


to 


-193 


-128 


183 


-014 


-070 


239 


-083 


-d7 


-010 


I 3 


li ^^5 


-23lt 


-070 


217 


-Id 


336 


049 


060 


-003 


-087 


Le X 


li78 


088 


-057 


173 


-097 


-090 


-048 


-084 


-138 


043 


Le 2 


558 


-lli3 


044 


143 


-233 


-049 


-188 


-049 


-dO 


la 


Le 3 


'■iS2 


-100 


-113 


123 


-179 


-179 


—224 


-020 


-016 


041 


Ma 1 


306 


273 


094 


-176 


-062 


-437 


-n2 


-143 


207 


-090 


Ma 3 


50l» 


319 


089 


-137 


-140 


-281 


038 • 


»207 


193 


-099 


N 1 


378 


7U7 


.^76 


124 


181 


144 


091 


087 


047 


030 


N 2 


582 


533 


-118 


008 


a 7 


la 


-133 


076 


003 


-004 


N 3 


ll27 


717 


-156 


039 


155 


173 


-082 


Q38 


084 


028 


0 1 


300 


132 


-001 


-271 


-301 


-139 


009 


1^ 


-127. 


107 


0 2 


51|8 


-237 


080 


-020 


-043 


283 


063 


-on 


•vcu 


-124 


R 3 


1 ✓ 


-233 


-004 


044 


161 


-0{'3 


-n 8 


274 


d8 


-177 


R h 


676 


-030 


-245 


036 


127 


-034 


-030 


167 


-020 


-073 


Re i 


U29 


-27U 


123 


-099 


101 


no 


-344 


Id 


071 


n? 


Re 2 


361 


-121 


172 


-179 


-213 


208 


064 


082 


337 


14S 


Rs 1 


103 


-188 


-206 


-143 


154 


-228 


-002 


021 


-la 


!J!2i.{ 


Rs 2 


609 


-133 


-227 


-062 


189 


-193 


1.03 


02:3 


-fD60 


-022 


Rs 3 


630 


-195 


-143 


-219 


213 


-193 


(0:6 


oej 6 


06? 


039 


Sep 1 


231 


003 


«149 


-418 


-313 


aa 


-079 


-C5f>7 


-083 


-226 


Sep 2 . 


3!^7 


063 


022 


-146 


-303 


-008 


124- 


124 


-191 


-n 8 


V 1 


li98 


-2li3 


060 


-268 


398 


i06 


-032 


-176 


-048 


109 


V 3 


li6U 


-267 


-046 


-197 


298 


176 


169 


-i 3 l 


05>’2 


on 


Xa 1 


1*70 


-200 


-a 6 


322 


-141 


076 


134 


040 


21^ 


024 


Xa 3 


312 


-3^8 


-Ui3 


141 


on 


-071 


-076 


130 


224 


-122 



IMif» 






122 



T&3IE 

Rotated Factor Matrix 
Kit Of . Reference Tests 
Grade 9 



FACTORS 



Variable 


I 


II 


Of 1 


-161 


«o?o 


Of 2 


-(^9 


-H5 


Cf 3 


-Hi 


-168 


,Cs 1 




-031 


G *? 2 


-oil 


-015 


V J 


'131 


-176 


^ ■,’i V 

A- a y 


1 

ro 

CD 


-122 


F' 


-222 


- 05 ? 


P . ■ 


-aa 


-078 


Fi X 


-178 


«a8 


Fi 3 


- 08 ^' • 


-033 


I 1 


-288 


-203 


I 2 


-528’ 


-016 


I 3 • 


-106 


-016 



Lq 1 
Le 2 
Le 3 



M 

K 

K 

H 

N 

0 

R 

R 



1 

2 

1 

2 

3 

2 

3 

ii 



Re 1 
Re 2 
Rs 1 
Rs 2 
Rs 3 
Sepl 
Sep2 

V 1 

V 2 
Xa 1 
Xa 2 



-09? 

-135 

-291 

t009 

-226 

-lijO 

-132 

-05? 

-279 

-602 

-929 

-375 

-08it 

-16? 

-609 

-692 

-OOU 

-260 

-582 

-iilO 

-122 

-a? 



-053 

-005 

-119 

-172 

-263 

-812 

-598 

-8oU 

-127 

056 

0k9 

-093 

-081 

“O 98 

-168 

-203 

-109 

-020 

-005 

069 



m 

-186 

-580 

-680 

-078 

-216 

-O 80 

015 

-1Q5 

- 12 it 

-080 

-128 

-208 

-171 

-31li 

-5It5 

-151 

-059 

025 

-161 

-185 

-0i|9 

-256 

-197 

-181 

-128 

“072 

026 
-211 
-109 
-0?0 
-065 

-Oil* 

oil 

-513 

-111 



IV 

-150 

«161* 

- 11*0 

-oa 

-098 

-310. 

-316 

-531 

-I 16 

-537 

-5a 

-215 

-0^ 

-227 

-081 

-120 

008 

-063 

-117 

-188 

-202 

-132 

-375 

- 068 . 

-a2 

-106 

-376 

-a? 

-071 

-159 

-521 

-126 

-353 

-230 

-070 

-037 



V 

-177 

-079 

-081 

-660 

-555 

-081 

-163 

Oil 

-05^t 

-021 

- 176 . 

-062 

-118 

-col 

-027 

-186 

-179 

-080 

-OlO 

-029 

-050 

-037 

«060 

028 

-Oil 

-252 

-21*3 

-OlD 
018 
116 
C'22 
-031 , 
06R 
072 
-072 



n VII vin 



239 
133 
069 
008 
2% 
013 
23? 
1C6 
17 i 

m 

055 

113 

ii::i 

072 

"Ode 

619 

136 

376 

127 

031 

-076 

057 

-122 

-099 

-084 

152 

-01)4 

-013 

csk 

175 

122 : 

016 

-077 



14? 

197 

i5l 

008 

072 

-235 

-060 

-077 

200 

Ho 

-123 

089 

la 

no 

-OlO 

-132 

-C 82 

002 

-137 

-071 

-013 

oca 

(^2 

199 

“100 

:i63 

157 

-ao 

075 

095 

086 

-a6 

-m 

109 

n? - 

157 



388 

175 

162 

033 

Q9S 

151 

-013 

158 

103 

-005 

079 

091 

000 

316 

HI 

107 

-052 

023 

031 

051 

051 

036 

181 

0 
2lO 
331 
036 
■'O 35 
061 
0 I 3 

177 

0^7 

-027 

115 

111 



H 


X 


039 


— 087 


016 


055 


059 


-219 


-017 


026 


042 


-117 


167 


-161 


075 


-la 


192 


-115 


090 


-371 


-075 


-080 


065 


062 


082 


-381 


-027 


-136 


070 


-la 


—000 


-052 


013 


-aa 


-065 


-067 


-087 


031 


- 05 ? 


-177 


oa 


005 


052 


-105 


GS6 


-082 


032 


-395 


-029 


-061 


000 


031 


070 


131 


-192 


151 


331 


-036 


189 


-162 


031 


-I 68 


-213 


' -IO 6 


-211 


-223 


H3 


-039 


051 


076 


-a9 


-081 


-031 


CM 

oo 

0 

1 



o 



123 



TABID hZ 

Rotated Factor Ifetrix 
Kit of Reference Tests 
iOrade 10 



FACTORS 



Vai?iable 


I 


II 


m 


vr 


Cf 1 


-239 


-033 


-033 


029 


Of 2 


-261 


086 


009 


-180 


Cf 3 


-323 


0lL6 


I4O 


-065 


Cs 1 


-055 


OhS ■ 


0S9 


-051 


Cs 2 


-06£. 


126 


cvsii 


-106 


Fa 1 


-126 


217 


135 


-1*52 


Fa 3 


-171 


-070 


29?. 


-196 


Fe 2 


. -009 


3ia 


376 


-288 


Fe 3 


-litl 


187 


357 


-1*37 


Fi 1 


-157 


103 


. 51*6 


-035 


Fi 3 


008 


163 


li38 


-113 


I 1 


-517 


258 


191 


-179 


I 2 


“Il79 


171 


026 


-163 


I 3 


-ill! 


06? 


088 


-103 


Le 1 


0l»9 




019 


-261* 


Le 2 


-236 


075 


100 


-11*3 


Le 3 


-366 


013 


038 


-276 


M 1 


019 


ita 


ca 


-069 


M 3 


-136 


339 


121* 


-265 


1 


-062 


817 


025 


-053 


B 2 


-195 


777 


-OH; 


-229 


N 3 


008 


861 


11*2 


-065 


0 1 


009 


-039 


1*97 


056 


0 2 


-08? 


OJJi. 


268 


-339 


R 3 


-31)0 


-Oiil 


-001* 


-303 


R h 


-37!) 


336 


070 


-1*71 


Re 1 


-153 


-082 


-096 


-1*59 


Re 2 


-121) 


005 


236 


-053 


Rs 1 


-21)6 


023 


-006 


-3a 


Re 2 


-517 . 


190 


018 


-1*1*5 


Rs 3 


-182 ■ 


087 


-O65 


-238 


SejO. 


-Ha : 


070 


61*8 


-100 


Sep2 


-075 ■ 


087 


291 


-1*27 


V 1 


-097 


11*5 


086 


-732 


V 3 


-200 


118 


-0l*6 


-609 


Xa 1 


-551) 


016 


11*2 


CM 

t-i 

t 


Xa 3 


-1)51 


-061| 


029 


oca 



V 


VI 


VII 


\1T£ 


3X 


X 


369 


-005 


1*99 


ni* 


1 

ro 


095 


51*0 


-029 


016 


069 


-131 


330 


65o 


-017 


107 


01*7 


-006 


151 


I6I* 


-100 


021* 


«n5 


-159 


631 


326 


-^051* 


01*7 


ni 


165 


31*2 


06I; 


-159 


059 


139 


028 


308 


070 


-151 


077 


031* 


-300 


088 


151* 


072 


071 


— ol*o 


023 


058 


102 


-0L\ 


027 


223. 


n6 


11*7 


-008 


-290 


003 


038 


-091 


076 


095 


-211* 


063 


Ol*6 


- 1*89 


237 


071 


-032 


171* 


126 


-069 


2n 


122 


-112 


195 


025 


015 


161* 


la 


-129 


01*7 


-051* 


-01*0 


010 


319 


-01*8 


161 


01*8 


11*1* 


01*9 


1*1*8 


-108 


151 


012 


-107 


007 


270 


-072 


01*3 


080 


11*1* 


093 


11*9 


091 


o’a 


577 


-096 


-061* 


-on 


-n8 


066 


556 


163 


015 


151* 


028 


-036 


3.30 


-017 


072 


026 


-051* 


0.21 


*^336 


-039 


-019 


-012 


-O26 


018 


065 


013 


066 


086 


-055 


•>088 


083 


-065 


132 


317 


'-a8 


153 


-021 


02?, 


009 


11*0 


••127 


oCj 


-005 


-081 


-005 


-Ol*8 


-012 


21 i* 


178 


-077 


11*2 


262 

160 

111* 


-171 

.•758 

-013 


159 

057 

-088 


01|.0 

-071 

-213 


-31*8 

-131 

-001 


063 

;i 65 

-082 


031* 


-303 


no 


095 


000 


000 


076 


-001 


701* 


090 


01*5 


017 


008 


032 


“O29 


-057 


067 


-107 


105 


067 


031* 


no 


-086 


-033 


130 


097: 


.190 


027 


—O85 


006 


108 


-122 


166 


077 


-033 


120 


21*8 


006 


103 


01*5 


-125 


001 


092 


063 


091 


-018 


023 


-01*2 
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ZABie 43 



Rotated Factor Matrix 
Kit Of Reference Tests . 
Grade 11 



Variable i 



H 



Cf 1 
Cf 2 
Cf 3 
Cs 1 • 
Cs 2 
Fa 1 
Fa 3 
Po 2 
Fe 3 
Fi.l 
Fi 3 
I 1 
I 2 
I 3 
Le 1 
Le 2 
Le 3 
M 1 



-306 

-042 
. -200 
-003 

-070 

-103 

-169 

-170 

-127 

-Olf.9 

-062 

-352 

*467 

-371 

-134 

-150 

-c5o 



M 3 
K 1 
H 2 
N 3 
0 1 
0 2 
R 3 
R 4 

Re 1 
Ro 2 
Rs 1 
Rs 2 
Rs 3 
Sopl 

V 1 

V 3 
Xal 
Xa 3 



-C^7 

-060 

- 28 ? 

-031 

“094 

-220 

-594 

-614 

-359 

-026 

-180 

-599 

-531 

IC^ 

-161 

-242 

-256 

-48o 

-311 



129 

103 

091 

008 

115 

116 
127 
0li3 

197. 

152 

125 

190 

-069 

-031 

068 

069 

254 

265 

831 

727 

802 

041 

024 

096 

304 

O83 

•112 

I 4 i 

21? 

203 

O69 

096 

043 

156 

040 

085 



FACTORS 



in 



IV 



^ VII vin 



124 -018 
234 -182 

089 -141 

090 -625 
-084 -756 
-032 -127 
139. -331 
029 -*065 
063 001 

QI4 -045 
001 -072 
198 -295 
168 -OCO 
097 -158 
-010 -120 

-043 -045 

-118 -oil 
-052 08I 
-i5i -ca8 
-007 -no 
-082 -c4c 

20a. (XXL 
536 ^ C 31 

022 -124 
089 — 062 
-054 -112 



007 

037 



C17 

014 



334 -100 
007 on 



05? 

035 



on 

202 



ao -025 
QOX -COLO 
066 «030 
124 -014 

353 020 



055 
156 
06? 
-056 
m 

325 

157 

-087 

154 

129 

174 

154 

154 

077 
-075 
026 
124 

078 

I60 

O67 

ao 

036 

-063 

261 

205 

078 

175 

-035 

234 

235 

439 
0H9 

254 

678 

700 

on 

207 



073 

105 

122 



195 

229 

037 



022 -060 
079 050 



285 

145 

.419 

465 

601 

lids 

070 

191 



150 

297 

141 

203 

‘078 

007 

378 

123 



191 -121 

032 166 

^9 -033 
2a -066 



053 

256 

099 

033 

239 



562 

612 

139 

109 

190 



362 -007 
192 060 
032 -091 
109 236 
-092 -040 

206 077 
-144 -12s 
171 069 



-0C9 

299 

33? 

185 

OLO 

158 

030 



133 

136 

107 

154 

061 

UO 

=159 



-4iii 
-666 
-756 
-184 
-179 
-092 
016 
-061 
-128 
-239 

-125 

-198 

-IGi 

-240 

-538 

-589 

-472 

-aa 

-039 

-109 

-174 

-063 

-012 

-452 

-283 

-209 

»220 

-2U 

033 

-170 

-102 

-125 

-191 

-056 

-103 

-334 

-241 . 



IX X 

306 008 
155 228 
120 -118 
041 096 

230 003 

471 055 

586 

-023 -C92 

130 016 

232 -246 

505 -072 

098 -048 

077 092 

142 -312 
-a6 -.111 
158 -116 
-043 1(^5 

235 -010 
«^o 

024 -025 
157 -009 
022 -019 
068 -120 
186 -217 
31.7 042 

225 029 

555 .<552 
384 -027 
026 060 
a6 

121 ? -355 

l4i) -610 

IGl -026 
230 049 

090 -(^5 

045 -035 

059 023 
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I 




I 




I 




I 




J 

>1 



I 

I 



I 

I 



r) 



I 








1 \ 



I 

I 




Rotated Factor Matrix 



Kit of Reference Tests 
Grade 12 

FACTCIvS 



Variable 


I 


n 


m 


IV 


V 


VE 


VII 


vm 


U 


X 


Of 1 


561 


203 


045 


-155 


-094 


-153 


— 138 


135 


-070 


-a 7 


Cf 2 


680 


la 


124 


-171 


-a 7 


009 


072 


033 


037 


029 


Cf 3 


706 


a 9 


185 


-102 


CO 


-oa 


-037 


103 


092 


-035 


Cs 1 


076 


a? 


772 


-019 


-046 


-074 


046 


073 


013 


-031 


Cs C 


285 


094 


606 


-222 


030 


-094 


-104 


-019 


0^9 


-128 


?F/, 1 


087 


150 


148 


-397 


-412 


-122 


-a2 


082 


-040 


0li9 


Fa 3 


105 


-032 


273 


-552 


-la 


-256 


-2a 


-000 


in 


— 2(18 


Fe 2 


137 


068 


-045 


-060 


-386 


-a 7 


143 


106 


091 


( fI 9 


Fe 3 


221 


*‘239 


-di2 


-184 


-311 


-a 8 


226 


01|5 


167 


262 


1 


iho 


113 


-091 


-037 


-4pa 


-C 52 


-008 




474 


077 


Fi 3 


233 


087 


324 


-186 


-392 


-138 


-339 


-003 


l4l 


-033 


I 1 


470 


197 


098 


-245 


-154 


-174 


175 


a 5 


030 


— 076 


I 2 


4 o 6 


-023 


065 


-143 


-no 


-017 


302 


233 


049 


140 


I 3 


4l8 


-013 


044 


-114 


-133 


123 


069 


328 


la 


-059 


Le 1 


433 


174 


053 


-028 


-152 


-122 


-a 3 


060 


-C0L9 


100 


le 2 


562 


-016 


060 


-084 


-128 


-132 


— 189 


166 


193 


067 


La 3 


457 


003 


-(^7 


as 


-131 


-191 


-161 


224 


060 


142 


M 1 


065 


149 


074 


-a 8 


-095 


-664 


-061 


039 


007 


064 


M 3 


224 


239 


m 


-102 


-223 


-610 


096 


a 9 


114 


-oa 


N 1 


121 


855 


134 


028 


-080 


-093 


109 


-066 


027 


-c46 


N 2 


234 


760 


a 2 


-167 


-154 


-144 


-113 


113 


-a 2 


026 


N 3 


139 


859 


-028 


-oa 


-la 


— 144 


-as 


-a 4 


054 


-052 


0 1 


088 


067 


066 


073 


-457 


-180 


-133 


-036 


174 


163 


0 2 


346 


003 


078 


-394 


-266 


103 


015 


248 


1^2 


-i45 


R 3 


250 


085 


163 


-242 


-166 


-036 


-149 


572 


-047 


097 


R 4 


364 


307 


-003 


-194 


-231 


-050 


-009 


.465 


-004 


198 


Re 1 


ao 


-colt 


0 : i 9 


-360 


«ci4 


C09 


-406 


275 


180 


086 


Re 2 


087 


-006 


la 


-213 


— 150 


072 


-058 


U42 


562 


-099 


Rs 1 


014 


— 076 


-073 


-la 


-038 


007 


-C17 


069 


-033 


474 


Rs 2 


289 


I4l 


024 


-289 


-228 


-138 


132 


363 


-05i 


352 


R« 3 


179 


108 


046 


-382 


-2n 


-200 


-007 


406 


094 


393 


S^l 


036 


-008 


-314 


-167 


-534 


-087 


-(Tt 


1>J2 


la 


-175 




123 


09(5 


126 


«*C80 


-431 


-039 


a 6 


083 


-oai 


ae 


V 1 


150 


068 


020 


-702 


-055 


-023 


-085 


n7 


025 


238 


V 3 


i4l 


047 


-002 


-610 


-081 


CSO 


li »6 


173 


14:J 


178 


Xt 1 


457 


052 


-003 


-0Q5 


008 


039 


229 


408 


293 


on 


Xa 3 


2C2 


-no 


-033 


-068 


040 


-032 


-ca 


525 


100 


0^47 



I 



iPKS&sawt<M 



O 

ERIC 
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TABIB 45 



Factor loadings: Humber Facility 



Name of Test 



Addition 
Division 
Subtraction ivnd 
Mult ip lication 



Grade; 9 


10 


11 


12 


Factor; II 


II 


II 


II 


* 


Factor 


Loadinjics 




•8i2 

•598 

.804 


• 8i8 

'Ml 


.811 

.727 

.802 


•855 

.760 

.659 



TABLE 46 

Factor loadings; Associative Memory 
Grade; 9 
Factor; Wi 



10 


11 


' 12 


VIII 


VII 


VI 



Name of Test 

Picture-Number 
First and Last Name 




Factor loadlnc^s 



.577 

.556 



.562 

.612 



.664 

.610 
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'JABLE 4? 

Factor Loadings: Speed of Closure 



Grade: 


9 


10 


11 


12 


Factor: 


V 


X 


IV 


III 


Name of Test 




Factor 


Loadings 




Gestalt Completion . 
Concealed Words 


.660 

.555 


.631 
• 3^2 


.825 

.756 


.772 

.606 



TABLE 48 

Factor Loadings: Fluency 
Grade: 



Name of Test 

Controlled Associations (al) 
Associations IV (fa3) 

Simile Interpretation (fe2) 
Word Arrangements (fe3) 
Topics (fil) 

Thing Categories (fl3) 

Plot Titles (01) 

Symbol Production (02) 
Apparatus Test (Sepl) 

Seeing Problems (Sep2) 

*Not in Ninth Grade Battery 



9 


3-0 


11 


12 


•: IV 


III 


VI 


V 


.340 






.412 


.316 


.297 






,613 


*376 


.419 


.386 


.416 


.357 


.465 


.311 


.537 


.^6 


.601 


. 4 o 8 


.521 


.438 


.483 


.392 




.^97 


.362 


.457 


*375 


.648 




.521 


.299 


.534 




.291 


.337 


.431 



f 






»• - Ik #, 






r 



I 



o 

ERIC 
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TABLE 49 

Factor Loadings: Verbal Reasoning 



Grade ; 
Factor; 



Name of Test 



Vocabulary (VI) 

Wide Range Vocabulary 
Controlled Associations (Fal) 
Associations IV (Fa3) 

Symbol Production (02) . 

Ship Destination (R3) 
Necessary Arithmetic 
Operations (R 4 ) 

Gestalt Transformation* (Rel) 
Object Synthesis (Rje2) 
Nonsense Syllogisms (Rsl) 
Logical Reasoning (Hs2) 
Inference (Rs3) 

Seeing Problems (Sen2) 
Locations (12) 

Word Arrangements (Fe3) 



1 



1 



1 



] 



9 


10 


11 


12 




I 


IV 


V 


IV 




Factor 


Loadings 




] 


.582 


•ps 


.678 


.702 


1 


.410 


.609 


.700 


.610 


J 


.431 


.452 


.325 


397 










.552 




.602 


.339 




.394 


A 


.303 






.529 


.471 








c 3?5 


.459 




.380 


w 




.321 






i 


.609 


.445 






-1 


.69a 




.^39 


*382 




.528 


.427 






J 




•437 









] 






1 ' 


















r' 



lit 



! 



I 



1' 



i 

I 

I 






I 

I 

I 



It 

I 



I 

I 

I 



O 

ERIC 
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TABLE 50 

Factor Loadings; Flexibility of Closure 



Grade ; 9 

Factor; III 



Name of Tes t 

Hidden Figures (Cfl) 
Hidden Patterns (Cf2) 
Copying (Cf3) 

Estimation of Length (Lei) 
Shorted Hoad (Le2T 
Nearer Point (Le3) 

Letter Sets (II) 

Locations (12) 

Figure Classification (13) 
Symbol Production (02) 
Match Problems II (Xal) 
Concealed Words (C52) 



.580 

.680 

.314 

.545 

.451 



.513 



TABLE 51 



Grade ; 
Factor; 



10 


11 


12 


V 


VIII 


I 


•369 


.414 


.561 


.540 


.666 


.680 


.650 


.756 


.706 


■M 


.538 


.483 


.448 


.589 


.562 




.472 


.457 

.470 

.4o6 

.418 


• 317 


.452 


.346 


.326 


.334 


.457 




s 


10 


11 


12 


I 


I 


VIII 



Name of Test 



Hidden Figures (Cfl) 

Copying (Cf3) 

Letter Sets (?1) 

Locations (12) 

Figure Classification (13) 

Nearer Point (Le3) 

Ship Destination (R3) 

Necessary Arithmetic Operations (HI) 
Gestalt Transformation (Rel) 
logical Reasoning (Rs2) 

Inference (Rs3) 

Match Problems II (Xal) 

Planning Air Manuevers (Xa3) 



.323 

.517 

.479 

.411 

.366 

.340 

.374 

.517 

.544 

.451 



.306 

.352 

.467 

. 371 

.614 

.359 

»599 

.533. 

.480 

.311 



.328 

.572 

.465 




.4o8 

.535 



1 



130 



TABLE 5ia 



Factor Loadings: Fluency In 

Making Verbal Transformations 



Grade : 
Factor: 



Name of Test 

Controlled Associations (Fal) 
Associations IV (Fa3) 

Topics (Pil) 

Tiding Categories (Pi 3) 

Gestalt Transformation (Rel) 
Object Synthesis (Re2) 



10 


11 


12 


IX 


IX 


IX 



300 


.471 

.586 




^♦89 


.506 


.474 


348 


• 5P5 






.384 


.562 
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TABLE 52 

Comnon Factors Apj>earing Only at Grade 9 
Figxiral Reasoning: Factor VIII 



Name of Test 



Loadings 



Hidden Figures (Cf- 1 ) 
Figure Classification (I - 3 
Estimation of Length (Le -1 
Object Synthesis (Re- 2 ) 




Unidentified: Factor X 



Name of Tes t 



Loadings 



Word Arrangements (Fe- 3 ) 
Letter Sets (I-l) 

Symbol Production ( 0 - 2 ) 



.371 

.38^ 

.395 



i 



. . TABLE 53 



Common Factors Appearing only at Grade 10 
Semantic Sedeflnitlon: Factor IT: 



Naiae of Test 

Object Synthesis (Re-2) 
Logical Reasoning (Rs-2) 



Factor Loadlnp rg 

. 768 . 

.303 



Deductive Reasoning: Factor Yll 



Name of Test 

Hidden Figures (Cf-1) 
Ship Destination (H-3) 
Inference (Rs-3) 



Factor Loadii).f];s 




Fluency in Making Verbal Transformations: Factor IX 



Name of Test 

Associations VI (Pa- 3) 

Thing Categories (Fi-3) 

Gestalt Transformations (Re-1) 



Factor Loadings 

.300 
.489 
. j48 
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TABLE 54 



Common Factors Appearing only at Grade 12 



Deductive Reasoning; Factor III 



Name of Test 



Factor Loadings 



Plot Titles (0-1) 

Nonsense Syllogisms (Rs-1) 
Planning Air Manuevers (Xa-3) 



.536 

.334 

.353 



Fluency in Making Verbal Transformations; Factor IX 



Name of T est 

Conti'olled Associations (Pa-1) 
Associations IV (Fa-3) 

Thing Categories (Fi-3) 

Gestalt Transformation (Re-1) 
Object Synthesis (Re-2) 



Factor Loading's 




Sensitivity to Problems: Factor X 



Name of Test 



Factor Loadinir.s 



Figure Classification (I-3) 
Apparatus Test (Sep-1) 



.312 

.610 



TABLE 35 



Common Factors Appearing only 


at. Grade 12 


Unidentified: Factor 


VII 


Name of Test 


Factor Loadinf^s 


Thing Categories (Pi-2) 
Locations (1-2) 

Gestalt Transformations (Re-1) 


-.334 

.302 

-.406 


Fluency in Making Verbal Transformations: Factor IX 


Name of Test 


Factor Loaditif^s 


Topics (Pl-1) 

Object Synthesis (Re-2) 


.474 

.562 


Deductive Reasoning; Factor X 


of Test 


Factor Loadinp;s 


Nonsense Syllogisms (Rs-1) 
logical Reasoning (Rs-2) 
inference (Rs-3) 


.474 

.352 

.393 




135 
TABIE 56 

RAgreseion An*3;f8e8 Qrado 9 
N - 300 








J 

l| 


Ifanber 

Facility 


Flexibility 
of Cloanre 


I 

S 


Speed of 
Closure 


0 

1 


sill 


C 
U 0 

V » 

s'*! 


0 

•H 

n q 

•H M 
^ 0 

55 


0) 

•P 

s 

& 

c 

1a 

1 




Multiple 

Correlation 

Coefficient 


Soove 

Predicted 




.32 


®3 








®7 


B 

13 


B 

9 




M 




K 


-.1*28 


-.Hi* 


.015 


-.039 


.032 


.177 


.086 


-.008 


.081 


-.067 


.62.9 


.568 


C 


-.352 


-•0i*l* 


-.D2 


-.187 


'•.087 


.065 


-.001* 


.029 


-.078 


.063 


81*.9 


.1*77 


Ap 


-.1*21* 


-.001* 


-.101 


-.157 


-.033 


.001 


.066 


-.01*9 


-.001 


-.060 


87.9 


.525 


An 


-.281* 


-.01*8 


-.132 


-.076 


-.01*9 


.011 


AID 


.013 


..on 


-.on 


76.6 


.379 


Sr 


-.155 


-.112 


-.019 


-.071* 


.038 


.006 


.002 


.008 


.121 


-.008 


59.5 


^292 


Er 


-.291* 


-.155 


-.030 


-.C09 


.102 


-.013 


.026 


-.016 


-.OID 


-.121 


72.7 


.U19 


K 


-.1*29 


-.090 


-.118 


-.073 


.081 


.181 


e051* 


-.082 


.121 


-.128 


73.7 


.591 


C 


-.1*22 


-.028 


-.21*7 


-.111* 


-.092 


.05b 


.030 


-.037 


-.02', 


-.026 


95.7 


.55b 


Ap 


-.552 


.018 


-.117 


-.075 


-.031* 


.031* 


.057 


-.001 


-.106 


.030 


87.2 


.593 


An 


-.1*13 


.027 


-.207 


-.079 


-.091* 


.038 


.020 


.137 


-.051 


.016 


79.9 


.51*6 


Sr 


-.215 


.012 


-.039 


-.162 


-.205 


-.122 


.063 


.01*2 


.082 


.H7 


71.1 


.1*01 


Sr 


-.375 


.185 


.025 


-.083 


.01*3 


.152 


.021* 


-/)05 


.006 


-.151 


7l*.3 


. 5 ia 


K 


-.1*32 


-.028 


.035 


-.099 


.033 


.239 


.032 


-.007 


.098 


-.038 


58.2 


.571* 


C 


-.1*68 


-.169 


-.002 


-.181 


«'e026 


.115 


.096 


.012 


.078 


.01*5 


7i*.9 


.612 


Ap 


-.1**7 


-.101 


-.055 


-.160 


<*(v022 


.078 


.101 


-.01*9 


-.01*5 


.029 


85.0 


.571* 


An 




-.118 


-.01*7 


-.139 


.01*8 


.098 


<066 


-.077 


-.010 


-.026 


81.2 


.526 


57 ■ 

• 


-.388 


-.151* 


-.020 


-.166 


.039 


.079 


.012 


.059 


.089 


”.259 


82.1 


.598 


Et 


-.257 


-.192 


-.081 


-.186 


v02l 


.112 


.067 


.031* 


.115 


.096 


63.1 


.1*81* 


K 


-.389 


-.139 


-.013 


-.108 


.067 


.226 


-.002 


-.005 


.020 


-.115 


72.9 


.587 


C 


-.5b9 . 


-.055 


-.031 


-.197 


-.097 


.11*9 


.098 




-.001 


.039 


©.6 


.628 


Ap 


-.1*63 


-.023 


-.061* 


-.19fe 


<•.015 


.031 


.212 


-.0.1*6 


«093 


—.006 


72.9 


.617 


An 


-.31*9 


.012 


.01*2 


-.150 


*='.083 


.192 


.olji* 


.067 


-.026 


.053 


58.6 


.1*72 


57 


-.359 


-.086 


-.063 


-.097 


-.011* 


.176 


.021 


-.Ola 


.005 


-.on 


73.2 


.1*75 


S7 


-.1*15 


-.102 


-.01*9 


-.11*2 


-.026 


4)32 


.031 


-.OiX) 


.030 


-.021 


^.2 


•5b9 



TABICS 57 



Repression Analyse® Grade 30 
^ - 275 



Score 


S' 

1 

•> 

1 


! 

o 

& 

J 


1 

m 

5 

pti 


1 
H C 

•S n 

II 


.p « 

H S 

E 


6 

0 

o| 

ll 

s ^ 

Is 


-p v: 
0 0 

•is 

ss 


1 


-1 

|£S 


Speed of 
Closure 




Mnlt4>le 

Correletlon 


■edicted 


h 


B2 


®3 




B5 


^6 


B7 


38 


Bp 


®10 


M 




K 


-.216 


.265 


. -.001 


-.362 


.066 


.012 


.2143 


.063 


o' 75 


.082 


38.13 


.629 


C 


-.188 


.269 


-.035 


-.Hi? 


.073 


-.096 


.2?r. 


.083 


".IC6 


.012 


I1I4.96 


•5o5 


Ap 


-.25b 


.170 


.0.13 


-.26? 


.093 


-.067 


.23I4 


.001 


-.091 


-.010 


58. lo 


.5I16 


An 


-.3Sb 


.lli3 


-.013 


-.190 


.C81i 


-.059 


.lli7 


.CM' 


.OT-2 


.09? 


M-.50 


.1)02 


sy 


-.091 


.163 


-.052 


-.2li? 


-.CIT 


-.020 


.1314 


-.00.. 


.065 


.086 


»i7.50 


.390 


Ev 


-a72 


.188 


.OOh 


-.iPh 


.062 


-.057 


.158 


.116 


\,0S2 


.112 


3l».00 


.1)6C' 


K 


-.21U 


.232 


.023 


-.3»«2 


-.007 


.016 


.339 


.«09li 


.072 


.156 


31. CO 


.617 


C 


-.273 


.239 


-.027 


-.299 


.097 


-.0143 


.3H» 


.032 


-.072 


-.001 


51.20 


.601 


Ap 


-.25h 


.093 


-.086 


-.316 


.161 


-.133 


.1426 


.003 


-.116 


.017 


51.70 


.666 


An 


-.202 


.097 


.031 


-.290 


.053 


-.026 


.186 


.021) 


-4)26 


.057 


51i.5o 


.1)55 


St 


-.161 


-.033 


.125 


-.2142 


.129 


-.n? 


.lit6 


-.132 


-4)li5 


.025 


68.80 


.1)59 


2t 


-.lli3 


.221 


.063 


-.317 


-.052 


-.019 


.182 


.015 


.160 


.061) 


U).7D 


.526 


K 


-.212 


.223 


.021 


-.325 


-.002 


.035 


.362 


.131 


.ol«5 


-4502 


37.8o 


.592 


C 


-.2liii 


.288 


.030 


-.339 


.C't 


-.037 


.31)9 


,058 


-.053 


.013 


1<5.S0 


.6110 


Ap 


-.2ijl 


.232 


-.029 


-.361 


-.017 


.009 


.355 


.139 


-.05? 


4)20 


1)6.90 


.629 


An 


I6l 


.190 


-.029 


.355 


.055 


-,027 


.256 


.076 


.01)7 


.057 


l|l4.C0 


.537 


St 


-.180 


.169 


.101 


-.3l|l4 


.002 


-.006 


.182 


.091) 


.old 


.025 


Ii5.1j0 


.535 


Er 


.000 


.235 


.126 


-.263 


-.051 


.05b 


.131 


.071 


4)18 


.01)5 


31.90 


.1)30 


K 


-.136 • 


.252 


-.031 


-.292 


-.0li3 


-.008 


.229 


.227 


.116 


.no 


28.60 


.582 


C 


-.2lli 


.126 


-.010 


•.3I45 


.016 


-.079 


.279 


.01)6 


.013 


4)31 


5it.ao 


.510. 


Ap 


-.206 


.178 


-/)15 


-.330 


.on 


-.058 


.281 


.051 


-.026 -4)03 


5I1.10 


.525 


An 


-.186 


.110 


.027 


-.166 


.oao 


-^79 


.287 


.062 


-4)79 


.002 


1*6.50 


.1)1)3 


St 


-.108 


.139 


-.027 


-e2l|2 


•occ 


-.0JJ3 


.196 


-.037 


.032 > 


>4)03 


1«9.7D 


.372 


St 


-.20i 


.106 


-.010 


-.232 


.109 


.035 


.191 


4)28 


4)33 - 


•4)38 


1)8.30 


.1)16 
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lABIS ^ 

BAgreBslon Aatl^o* Gx«de 11 
N • 282 




Score 



Predicted 


®1 


B2 


■ ®3 




®5 


®6 






»9 


®3D 


M 




K 


-.226 


.089 


.01*1* 


-.036 


.337 


.305 


.250 


.035 


-.032 


-.01*5 


23.30 


.576 


C 


-.215 


.097 


.020 


-.098 


.155 


.309 


.321 


-.097 


.307 


-.01*1 


31.7D 


.1*59 


ip 


-.252 


.122 


.081* 


.008 


.225 


.305 


.361 


-.079 


.335 


-.01*8 


26.30 


.552 


An 


-.199 


.109 


. 08 d 


.01*1 


.11(0 


.331 


.083 


-.098 


.130 


-.067 


32.00. 


.1*60 


Sr 


-.130 


.327 


.oU) 


.062 


.189 


.085 


-.011 


-.OU 


-.033 


.021) 


33.30 


.365 


Et 


-.l8It 


.071 


.Ola 


-.007 


.121 


.169 


.126 


.061* 


-.300 


.005; 


31*.20 


.381 


K 


-.307 


.17li 


-.030 


-.01*6 


.192 


.081* 


.236 


-.038 


-.007 


-.01*5 


38.80 


.532 


C 


-.336 




.111* 


-.057 


.21*9 


-.001* 


.055 


-.197 


.079 


-.01*5 


1*9.00 


.605 


Ap 


-.375 


•13U 


.108 


-.061* 


.232 


.01*2 


.082 


-.135 


.186 


-.019 


38.90 


.628 


An 


-.277 


.120 


.061* 


-.011 


.177 


.019 


-.001 


-.212 


.081 


-.031 


53.20 


.500 


Sy 


-.205 


.088 


.093 


.056 


.191* 


-.022 


-.132 


-.231 


.121 


-.065 


53.30 


.502 


Et 


-.172 


.132 


.11*5 


•J02h 


.11*8 


.170 


.166 


«.0l*2 


-.026 


.033 


23.80 


.1*1*8 


K 


-.309 


• Ilf ) 


-.005 


.073 


.237 


.01)3 


.135 


-.022 


.068 


.061 


29.30 


.527 


C 


-.320 


.162 


-.060 


.025 


.275 


.059 


-.001 


-.033 


.076 


-.001 


lo.lo 


.557 


ip 


-.336 


.332 


.011* 


-.005 


.295 


-.033 


.053 


-.133 


.097 


-.061 


1*7.30 


.606 


An 


-.313 


.108 


-.021) 


.053 


.266 


.035 


.078 


— .0J)1) 


.061* 


-.056 


1*2.60 


.521) 


Sr 


-«220. 


.lli2 


.006 


.037 


.31*1* 


.11*1* 


.301* 


-.073 


-.083 


.009 


29.00 


. 51*8 


Bt 


-.213 . 


.11*8 


.006 


.001* 


.331 


.305 


.093 


-.01*5 


-.050 


-.033 


U.D 


.378 


K 


-.231i 


.209 


.032 


.067 


.219 


.31*5 


.231 


.031* 


-.011 


.026 


ll*.30 


.538 


C 


-.333 


.11*6 


.01*2 


-.009 


.318 


.137 


.122 


-.01)2 


.055 


-.01*7 


29.00 


.602 


ip 


-.320 


.185 


.063 


.015 


.279 


.132 


.11*9 


-.301* 


.091 


.056 


23.30 


.636 


An. 


-.21*3 


•llil* 


.075 


-.006 


.171 


.111 


.059 


-.01*1* 


.060 


-.033 


33.70 


.1*37 


8P 


-.167 


.153 


.076 


.031* 


.231 


.062 


.021 


-.01(0 


—.031* 


-.009 


32.00 


.1(02 



Bv -.189 ,159 .136 .099 .225 



.058 .118 -,oo5 -.018 .015 17.50 .b71 
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TABIE $9 



Regveasion Amlyaes Grade 32 
N - 267 




I 





Seoca 



Predicted 




®2 


% 


® 1 ( 




K 


•219 


•030 


-.0^ 


-.123 


•065 


C 


.257 


.095 


-.OX 


-. 181 , 


-.069 


Ap 


• 2 k) 


.231 


-. 01(2 


-.233 


-.077 


An 


•201 


.093 


.075 


-•X 8 


.606 


Sr 


•092 


.053 


-.01(5 


-Jb61( 


-.05? 


Bv 




•llilt 


-.176 


-.01,9 


1 

b 


K 


oJ62 


.117 


•025 


-.193 


-^112 


C 


.238 


.075 


•008 


-.332 


-.093 


Ap 


.113 


.025 


•000 


-.299 


-.111 


An 


•Oh? 


*='•008 


-.Oldi 


-•XI, 


-.133 


ftr 


•im 




,009 


-.231, 


-.236 


St 


•009 


.097 


-.096 


-.156 


-.199 


K 


•lilt 


.119 


.095 


-.X9 


O 

• 

1 


C 


.025 


.058 


•Ok) 


-. 1(16 


-*095 


Ap 


•0» 


•020 


-.007 


-.377 


.022 


An 


.028 


•001 


-.027 


-.396 


-.068 


Sr 


-.037 


->.001 


-.OX 


-.257 


-.226 


It 


.228 


.006 


-.028 


-.058 


-.126 


K 


.078 


•31(8 


-.031 


-.oX 


-.XI 


C 


.092 




-.003 


-.31(6 


SI 

0 

• 

1 


Ap 


•Dli5 


•096 


•005 


-.331( 


-.067 


An 


.0li9 


.170 


-.029 


-. 21 ( 1 , 


-.062 


Sr 


.007 


.133 


-.006 


-•X 6 


-.223 


St 


-.035 


•018 


-.05U 


-•U(l( 


-.353 



®6 




®8 


®9 


"x 


K 




-.003 


.252 


.127 


.066 


.229 


x.x 


.1,33 


•003 


.085 


.21,8 


.037 


xo5 


37.x 


.396 


.052 


•021 


.191, 


• 06 I, 


.339 


19.x 


•X9 


.003 


-.035 


.m 


.086 


.059 


2>4.X 


.371, 


J)02 


.081 


.232 


•069 


.268 


22.x 


.1,28 


-.039 


.176 


.129 


.059 


.228 


33.x 


•1,21, 


-.059 


.031 


.337 


-.023 


.072 


1(1.X 


.1,31 


.021, 


•023 


.21,9 


-.036 


•01,6 


li5.X 


.553 


•OX 


.026 


.281, 


-.XI 


.087 


1,8.x 


.557 


•026 


-.028 


.21,2 


•003 


•092 


1,8.x 


.137 


.098 


,023 


•221, 


-.OX 


•X9 


37.x 


.)i23 


-.029 


.200 


.066 


.02? 


.091 


1,8.x 


•130 


-.013 


-.002 


.222 


-.056 


•X9 


31,.TO 


.588 


.058 


.026 


.251, 


.027 


•XI, 


X..X 


,6Wi 


.063 


.022 


.21,6 


.023 


•X9 


37.x 


.581 


-.008 


•082 


.251 


•06I, 


.231, 


US,5o 


.589 


-.008 


.11,8 


.31,6 


.012 


.096 


57.x 


.1,82 


-.01,3 


.353 


.025 


•OX 


.017 


.16,90 


.280 


-.XI 


.181 


.053 


.027 


•OX 


36.x 


•3X 


-.023 


.228 


.239 


-.037 


•X2 


1,1.x 


.578 . 


.031 


.122 


.222 


-.01(7 


.351, 


33.00 


.581 


.127 


.070 


.225 


.029 


.31(6 


25.x 


.517 


-.005 


.332 


•m 


Xl(7 


.21(6 


33.x 


.3X 


-.006 


•169 


.200 -.018 


.239 


1,7.x 


.385 
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ZABI£ 60 

SuBnary of Significant Beta Weights 
Grade 9 



•a 



I 

i 

{ 

< 



Xtacwledgtf 

AS • -Bi 

G » 

L • 

CoiVMhiiwloiit 

L •-B? 
BS » 

1 

ApiGloatio&t 

AS --B, 
G •■-BT 
L •-]?• 
BS 



AnaiyBist 



AS » 

G » 

L - 
BG » 



Syutheel8» 

AS 

Q 

L 

BG 



*-5i 

• -B, 

Bralnfttlcat 












i 

I 



■ 




I 



f 

t 






M 



i 
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-I!iVBI£ 60a 



Summary of Predictors of Level Scores, over Forms 
by Grades with Significant Beta Weights 



Grade 9 



•ri 

§ 

fl 







S 

w 

« ' 

05 • 
P 









% 



-P 

'C -P 

^ •fl 



f s2 

^ 0 
•H fH 



•H 

c 

o 

«r 

05 

H 

e 

fc« 



s 

t 

& 

I 

I 



Khowledge: 



(AS) 


-.437 -.UN 


+.i8m 




(G) 


-.437 


-.12Cf +.i8m 


+ .1^3 


(L) 


-.437 


-.lOP +.24>i 


.r +.1CSS 


(EG) 


-.397 -.14n • 


-.IIP +.23i«. 


■ ^ 



+.13U 

-.12U 



Comprehension: 

(AS) 

(a) 

(L)^ 

(EG) 



357 


-.lOCf 


-.19P 


437 


-.25Cf 


-.UP 


477 -.17N 




-.19P +.134 


517 




-.20P +.15M -.lOCs 






+.10Xa 

+.i'OXa 



I 

1 

1 

I 

] 

1 

J 

1 

! 

1 



Application: 



(AS) 


-.427 


. -.lOCf -.16P.. 


, T- 


(0) 


-.557 


-.12Cf 


-.11^8 ,, 


(L) 


«.4fi7 


-.1^ -.i6p 


+.lQXa 


(EG) 


-.467 


-.19F 


+.09RS +.2UCa 



Analysis: 



(AS) 


-.287 




-.13Cf 










(0) 


-.417 , 




-.21Cf 








+.l4Pr 


(I.) 


-.417 ' 


-.12N 


-.14p ■' 




1 






(EG) 


-.357 ■ 




-.15? 


+. 19 M 


■ 






Synthesis: 
















(AS) 


-.167 


-.ilN 






+.12RS 






(G) 


-.227 




-. 16 p 


-.124 


-.20Cs ■ - 


* 


+.12U 


(L) 


-1397 


i 

• 

1 


-.17P 


+.oaH. 


■ , M 




-.16U 


(EG) 


-.367 






+.iew 








Evaluation: 






•• 










(AS) 


-.297 


-.i6n 










+.12U 


(G) 


-.387 


-.i8n 




+.15M 


+.10CS 






(L) 


-.267 


-.19N 


-.19? 


+.UM 


+.12RS 






(EG) 


-.427 


-.ION 


-.l4p 











\ . 



1 

I 

i 

1 

} 



r 



1 




t 



r 




Snoffledge* 
AS • 

0 • 
L « 
B5 *• 



-Bt 



Conprohenslons 
AS • ""Bjii 

S3 » 




fiiTGiluatloiit 
AS • 

(^ i 

L • 

Bl • 
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IABI£ 6l 

SOT11B17 af Signtflcanfc Beta Wel^te 
Qsade 10 





% 

I 







% ”?6 






% 
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TABLE 6la 



Summar/ of Predictors of Level Scores, over Forr.s 
by Grades ^•ith SignJficsuit Beta Weights 

Grade 10 



1 

] 



•H 

c 

o 

m 



•H 







CD 

1) 

txi 


o 






H 


u 




o 

OJ 


9 


9? 




ca 

a: 


% 




Knowledge: 




(AS) 


-.22R 


-.36v 


+ . 26 n 


(G) 


-.21R 


-.34v 


. +.23N 


(L) 


-.21R 


-.32V 


+.22N 


(EG) 


".14r 


-.29V 


■ +.25N 


Compreheiicion: 








(.15’) 


~,19R 


-.15V 


+ .27N 


(G) 


-.27R 


".30V 


+ .24n 


(L) 


-.24r 


-.34v 


+.29N 


(EG) 


-.21R 


-.34v 


. +.13N 


Application: 








(AS) 


-.r.5R 




+.17N 


(G) 


- 25R 


-.35V 


+. 09 N 


(L) 


-.24r 


-.36v 


+ .23N 


(EG) 


-.2X1 


-.31V 


+ . 18 n 


•Analy'^ts; 








(AS) 


-.15R 


-.19V 


+.14n 


(0) 


-.20R 


-.29V 




(L) 


-.i6r 


-.35V 


+ .19N 


(EG) 


-X9R 


-.17V 


+ .11N 


Synthesis 








(AS) 




-.24v 


+.i6n 


(G) 


-.i6r 


-.24v 




(L) 


-.i8r 


-.34v 


.•+.17I^ 


(EG) 




-.24v 


+.i4n 


Evaluation 








(AS) 


-,rm 


-.l8v 


+ .19N 


(G) 


-.i4r 


-.32V 


+.22N 


(L) 




-. 26 v 


+ .22N 


(EG) 


-.21R 


-.2lv 


h.UN 



m 

c 

o 

•H 









2 




•H 

C 

o 








3 


.V O 


0} 


• 


• 




CQ 


a 


cr 


ts 






O 

iH 

U 




a: 

p:; 










•H 


Of 


•H 92 


• & 
c 




O 

XJ 


O rH 
C CD 


•P 

o 

'6 

0) 

p 


S'-* 

rH U-i 
O 


S 

iH 


W 

E 


V 

0) 

a 

ro 


S'? 

rH © 

|X4 



+ .0^ 
+ .13M 
+ .23M 



+.l6cs 

+.10Cs 



+.12FVT' 



-.lOCf 



+.i6cf 



+ .1W 



■.12JVT 



+ .12F 
+.10F 



-.13M 



+.12M +.11CS 



+.ncf 



+ .13P 



+.i6bvt 



+.24Rd 

+.34Rd 

+.36Rd 

+.23Rd 



+.23Rd 

+.31Rd 

+.35Rd 

+.28Rd 



+.23Rd 

+.43Rd 

+.36Rd 

+.28Rd 



+.15Rd 

+.19Rd 

+.26Rd 

+.29Rd 



+.13Rd 

+.15Rd 

+.l8Rd 

+.20Rd 



+.l6Rd 

+.l8Rd 

+.13Rd 

+.19Rd 



a 

o 

•H 

-P 

•H 

c 

•H 

a; 

T 

o 

a 

•H 



0) 

CO 



•.llRe 



».12Re 



ERIC 



I 



s 

I 

I 

I 

I 

T 

3 . 

I 



I 



It 

1 

I 

I 

I 

I 



M 

O 

09 

CO 

& 

Eamledget 

AS « R 

L » E, 



Ea 



Conpr^nsion* 

AS « 

G « -BT 
L « -& 
EG 

ApF^cation: 

AS « -E, 
G 

L • «»Bi 

Bj « “1^ 

AnsG^BiS} 

AS « 

G « «B 
L « -B^ 
EG • 

Synthesis: 

AS « -B, 

? Z‘$ 

L “ ■•Bt 
m ^ -Bj^ 

Evaluation 

AS « -Bi 

L « -B-j 
EG « 
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TABIE 68 



Suinnar7 cf Significant Bata Wei^ts 



s 

O 

P 

h 

o 

-S 



I 



^2 

B2 

B, 



Bg 



®2 

P 

b| 



B, 



Bj 



h 



|g‘ 

•H Ti 
•P C 
O O 
S) 03 

•a *0 



a 



S3 



B, 



(h^de 11 



^ © 

•o ^ 
© © 
© o 

O.H 
CO O 



®2 % 



bO 



H C 
© O 
43 © 
© 



-Bi. B, 



B^ 



B, 



>» 

© 

{*< 






B6 Bj 



I B, B7 

% 06 ®? 



®6 ®Y 



0? 



% 
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TABLE 62a 



Summary of Predictors of Level Scores, over Forms 
■fay Grades with Significant Beta Weights 



1 



Grade 11 
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00 

CD 
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•H 
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CO 

rH 

CO 
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•H 

H 

•rl 
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CO 

U 
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H 
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o 
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<D 
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Knowledge; 



o 

si 

^ o 
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C CO 
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c 
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00 
CO 

1 

o 

.0 
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<D 
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O 

•P 
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(AS) 


-.23R 


+.34v . 






+.10F 


+.25M 






(G) 


-.31R 


+.19V 


• +.irN 






+.22M 


' 




(L) 


-,31E 


+.24v 


+ .l4u 






+.12M 


• 




(EG) 


-.23R 


+.22V ■ 


+.21N 




+ .14P 


+.23M 






Comprehension; 










.• 








(AS) 


-.22R 


+.l6v 


- +.10N 




+.11F 


+.12M 


-.lOCs. +.11WT 




(G) 


-.34r 


+.25V' 


+.15N 


-.20Cf 








+.llRd 


(•“) 


-.32R 
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+ .16N 












(E3) 


->.31R 


+ .32V 


+ .15N 




+.14f 


+.iai 






implication; 
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-.25R 
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+ .l^i 
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-.38r 
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(EG) 


CVJ 

• 

1 


+.177 


+ .14n 




■♦.IIP 








Synthesis; 


















(AS) 


-'.13R 


+,197 


+ .13N 




- 








(G) 


-.20R 


+.197 




-.23Cf 




-.UM 


+.12FVt 
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TABI£63 

Smm3.7 ot Significaafe Beta Vel^s 
Grade 12 
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TABLE C3a 



Summary of Predictors of Level Scores, over Forms 
by Grades with Si'gnific^t Beta Weights 

Grade 12 
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(G) 
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(EG) 
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+.14r 

+.22R 


-.UV 

-.19V 

-.31V 


+.12N 
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+.15N 


+.22Cf 

+.l6Cf 
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Comprehension; 

(AS) 

(G) 

(L) 

(EG) 


+.15R 

+.25R 

+.25B 

+.24r 


-.l8v 

-.33V 

-.42V 

-.35V 


+.1QN 


+.l6cf 

+.l4cf 


-.lOF 

-.lOP 


implication; ' 
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(G) 

(L) 

(EG) 
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+.25R 

+.22R 
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+.13i^ 
+ .10N 


+.24cf 

+.ncf 

+.l4cf 


-.UP 
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+oUR 
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Synthesis: 
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Evaluation: 
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Compay Isons by grade and form. Por Grade 9 - Atomic Structure, 
verbal Reasoning is the only ability common to all process ' 
levels, although a fluency factor, either Flexibility of 
Closure, Number Facility, Fluency, or Speed of Closure appears 
at each process level. The combination of Verbal Reasoning, 
Number Facility and Memory factors in the equation for 
Knowledge Is probably the most logical one In terms of the 
process . 



For Grade 9 - Glacier s „ Verbal Reasoning and some kind 
of fluency again appear at each level for this test form. 
Although the appearance of the Memory factor In the Knowledge 
equation is logical. Its appefirance in the Synthesis and 
Evaluation process equations Is difficult to explain on 
the basis of the taxonomy structure. However, the reader 
recall that the simplex ordering of subtests according 
^ empirically determined complexity was Knowledge, Synthesis, 
Evaluation, Comprehension, etc. Consequently, the appearance 
of the Memory factor in the Knowledge, Synthesis, and 
Evaluation equations Is not unreasonable. 

For Grade 9 - Msbon Earthquake , the equations show 
more consistency than do the others for grade nine. Verbal 

Fluency appear in all equations; Number 
Facility appears in all except Knowledge; and Memory appears 
in four of the six equations. At the ninth-grade level, 
this form was the only one for which the theoretical order 
and empirically deterralned complexity order were identical. 

For Grade 9 - Stages of Economic Growth . Verbal 
Reasoning appears In all equations and Fluency "appears In the 
equations for the first four levels. The Synthesis equation 
contains only Verbal Reasoning and Memory which do not agree 
particularly with the definition of the process. However, 

synthesis was ordered by the simplex immediately after 
Knowledge. ^ 



« ^ For Grade 10 Atomic Structure , the equations for 

Knowledge, Comprehension, Application and Analysis contain 
tne same four predictors. Reasoning, Number Facility, Verbal 
Reasoning, and Deductive Reasoning. The more general 
Reasoning factor drops out of the Synthesis equation. Speed 

Memory appear In the Evaluation equation in 
addition to the four factors present at the lower levels. 



Reasoning, Verbal Reasoning 

and Deductive Reasoning are common to all process levels. 
Fluency factors appear at several levels, in several 
combinations. 



o 
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. . 10 - Lisbon Earthquake , four factors— 

three reasoning factors ana number Facility— appear in the 

Knowledge through Synthesis. The equation 
^filuation lacks the general reasoning factor and has 
an additional fluency factor.- Memory appfart in tS 
equations for Knowledge and Application. 

Qrade 10 - Stages of Economic Growth , the 
same four factors—fleasonlng, number Facility. Verbal 
Reasoning, and Deductive Reascning— -appear in five of 
me general reasoning factor Is the only 

anrt fPO® the sixth equation. Memory 

factors appear In addition to the four ^ 
at tne Knowledge level. 

Verbal ~ A toml^^trueture . Reasoning and 

ys appear in afT equations ; Fluency appears 

pLility^i8*nreL®y“y*’* Synthesis and Number 

EMiiiaJLi® except that for Knowledge and 

SJ5“pp.„. 

at all levels except Synthesis; Flexibility of CloLS 
enters at the Comprehension level and remains in all 

SanSoraetlont^a°”^’ fluency in Making Verbal 

srgssir "■ “» •««*'“'“ '» »ppii=.Ho, 

also appears in the Knowledge and 

Knowledgrand^cympr4hensLnrthM 

define Appllcatioh; the number orfactora rtLn, J"T^ 
Analysis, Memory and Plpxlbll i<-» on ^ 2**® 

and for WhesLrLSSS^fvLSli^ReSoM ’ 

Facility are the only faeto?s a;^ Number 

equation for Eraluatlon confl^ots with^S trms^f 

two of”hlch\r^ot'^yppeL®°?n^ 

any of the other equations o 
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- . ~ Atomic Structure , fluency and reaaon^no* 

factors deflH^a±l process levels except for S^thesis 
Reasoning Is the only significant factor. ^y^^»®sls where 

Grade 12 - Glaciers , fluency and reasonlne factors 
appear In all six eQuatlons. All eouatlons exceot Eval1lfl^•^rkM 
Include two reasoning factors and all eouatlons 
for Analysis, and Evaluation Include twSenoy Srs!‘’°"® 

some progression , ^Know ledge°l8^??ned^b y^both^f i 
reasoning factors; fluency becomes ilTlmport^^^ 

Comprehension and for Apnllcation , 

factors appear. There reasoning 

Synthesls'Sh^h 

Evaluation which depends only on Flexibility ofMosure. 
for Knowledg I* tteough~ anai growth , the equations 

three reasoning fllforfS^oL'IlST?^^ ’ 

of the unidentified factor l^flve of presence 

complicates the interpre?LiSn"ortSLnquatlZ?"'°"" 

Slfli^ol^Fo-clir^ comparisons, a 

If two or more o/the ILe Infeirred only 

predicted by the same c^nltl?e ?Ltlr! slsnlflcantl 

for the ^cess^sforesl* following equations can be written 



S' 



Common Factors 
-Y__~N “cf p jf 



Cs 



Knowledge 

Comprehension 

Application 

Analysis 

Synthesis 

Evaluation 



Special 

Factors 



V + 

V "V 

V 4- 

V + 

V + 

V + 



+ 



N H- 



Cf 

Cf 

Cf 

Cf 



+ 

+ 

+ 



p 

p 

p 

p 

p 



+ 

+ 

+ 



M 

M 

M 

M 

M 



+ 

+ 

+ 

+ 

+ 



Rs + 

Xa 

Rs 

U 

U 



U 



They shoulfL^lnte^rltld^vrL^IJ!^^^ equations. 

The abilities Impor^t fm.. ?h» ^ following example: 
Verbal Reasoning^ Plexlbllltv^ftf‘^r?«o®''^”®^?^ process are 
and Pigural Adaptive Flexibility Fluency, Memory, 
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Verbal Reasoning is the only ability common to all 
processes at grade nine. Fluency plays a significant role 
*or all levels except Evaluation, Other abilities which 
^e significantly related to pr'rformance are Plexibilltv of 
Closure, Number Facility, and the Unidentified Factor, 

In general, the eQuatlons for grade nine do not present 
any clear patterns, 



Grade Ten , 
for grade ten: 



The following equations were determined 



Knowledge 

Comprehension 

Application 

Analysis 

Synthesis 

Evaluation 



Common Factors 
R V ~N D? — — cs 



Special 

Factor s 

« ■MMHMBWMKaWNi 



R + V + N + 
R + V -O- N + 
R + V-*N + 
R + V + N + 
R + V + N + 
R + V + N + 



M + Cs + 



F + 



F.d 

Rd 

Rd 

Rd 

Rd 

Rd 



4-har* 4.V grade ten are much more homogeneous 

factors-Reasoning, N^ber 

"i Verbal Reasoning, and Deductive Reasoning=-are 

significantly related to all process levels. In addition, 
hemory and Speed of Closure appear only at the Knowledge 
level, where they could logics? ly be expected and thereby 

E? theoretical speculations about the nature 
of that level. Fluency, the process of putting various 
aspects of knowledge together in wayr to form new products, 
appears as a significant predictor for Synthesis. 

The following equations were determined 

for grade eleven: 



Knowledge 

Comprehension 

Application 

Analysis 

Synthesis 

Evaluation 



Common Factors 

R V N ~W ^ ,N) — Cs 

R + V + N+ F + M 

R + V + N+ F + M 

R + V + N + Cf + F + 

R+V+N+Cf+F 
R + V + N + M 

R + V + N+ F + M + 



Special 

Factors 



FVT 



Rd 



*is». The patterns for grade eleven, while more homogeneous 
tha.j\ those for grade nine, are not as clear as those for 
grade ten. Three factors. Reasoning, Number Pacliity and 
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Vet‘bal Reasoning appear in the equations for all levels: 

Memory and Fluency appear in five of sis equations but Memorv 

Analysis and Fluency drops out on Synthesis. 
P-exlcxAlty of Closure* is significant for Application and 
Analysis; in addition^ Fluency in Making Verbal Transformations 
s^SJ'ff^lcantly related to Application. In Qillford’s 
claosification, Piesiblllty of Closure is said to reoresent 
c^vergent production of figural transformations. The factor 

of verbal 

transformations. Hence, these relationships appear to be 

and Analysis Involve trans- 

wh^h^ 4 na?„o 4 o *PP^-*®Ji0'*^®Psn<Js on divergent production 

?oJ1vS?on frLg?clllf IffSr® 

for gradFT l I l ^ r — ‘ following equations were determined 



Knowledge 

Comprehension 

Application 

Analysis 

Synthesis 

Evaluation 



Common Factors 

K V N ur F 7!s 

R + V + N + Cf + 

R + V+ Cf + p + 

R + V+ N + Cf + 

R + V + 

R + V + P + 

V + p 4. 



Special 

Factors 



Rs + IJ 

Rs 

Hs 

Rs 

U 

Rs + 0 



n all six eq lat ions , Reasoning and Syllogistic ReasoninS^ 



grade levels on each form. The reader^la ?r >acre 

same factor designation at dlffereSt*^«L’^i^,^"?®^a**'®* 

2«ply the same fictor coS^onS '*“®® “®* 

written CTe^Sc -|u !^ure1o^^^^ "® 





I 

I 

I 

I 

I 

[ 

[ 



Common Factors 

g y M P — H — Ua 



Special 

Factors 



Knowledge 

Comprehension 

Application 

Analysis 

Synthesis 

Evaluation 



R 

R 

R 

R 

R 

R 



+ 

+ 

+ 

+ 

+ 

+ 



V 

V 

V 

V 

V 

V 



+ 

+ 

+ 

+ 

+ 



N 

N 

N 

N 

N 

N 



+ 

+ 

+ 

+ 



Cf + 
Cf 4- 
Cf 



M 



F 

F 



M + Cs 



Reasoning, general Reasoning, and Number 
Pani^ity factors are common to all process levels. The 

fluency and/or reasoning factors for 

4 n S logical expectation. Memory, appearing 

in the equation for Knowledge is to be e.xoected- tL oresence 
of M^ry ^d Speed of Closure in the EvaluaUoA equatilf 

the Slacliir^. following equation can be written for 



' 1 . 



[ 

I 



I 

I 



Com mon Factors 

cT~f — s — es 



Knowledge 

Con5>rehens ion 

Application 

Analysis 

Synthesis 

Evaluation 



R 

R 

R 

R 

R 

R 



+ 

+ 

+ 

4* 

+ 

+ 



V 

V 

V 

V 

V 



+ 

+ 

+ 

+ 

•f 



r 

N 

N 

N 



+ 

+ 

+ 



V 4- N 4- 



Cf 

Cf 

Cf 

Cf 

Cf 



+ 

+ 



M 



F + 



P + M 
P + 



Special 

Factors 



Rd 

Rd + PVT 



Rd 



ftf •h'rto factors in the equations for four 

««rs;.g,'xiss-„*arar 



_ Common Facto rs 

ir~ V ti er —v m a. 



Knowledge 


R + V 4* 


Comprehension 


R + V 4* N + 


Application 


R + V 4- N 


Analysis 


R + V •?» N 


Synthesis 


R + V + N + 


E't'aluatlon 


V + N + 



M + 



M 



Special 

Factors 

Rs 



P 






li 
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stoll^ Sctorrift^MLSraldfd t^?hf KnSwSe eouItiZ 

and Pxuency •^dded to the Comprehension equatlonl Evaluation 

SSS 4 ° r 2 . S “"“““'’ * 



Knowledge 

Comprehension 

Application 

Analysis 

Synthesis 

Evaluation 



Common Factors 


Special 

Pact'^rs 


R V N Cf P M c¥ 


R + V + N-f P4*'M 




R + V + N r p 




R + V+ N-?-Cf + 


Rd 


R + V + N + M 




V + M 




R+V+N+Cf+ 


Rd 



o . i ive equations contain the same fou^ factoT*^ Vpr»h»ai 
wflir* io" and Evaluation; anf 



following discussion 

h« erade considered ove^^fo™^ 

h«rt ^ equation for a grade, the cognltlvrlactor 

?«« appear as a significant predictor of the process for 

g ? 2 df nine® LS s^ririor 

gx^ae nine, the second for grade ten, etc. 

Knowledge 



*10 

*11 

Ki2 



m 



V + N + 

R + V+N + 

R + V + N + 
H+V+N+Cf+ 



P + M + 
P + M 



Cs + 



Rs 4 U 
Rd 

Rs 4. u 



Verbal Reasoning and Number Pacllltv are sieni f»an<- 
predictors ^^nowled*?#* on ^ ««^e signii leant 

JS'Si.nM 3Ls; Ki.ss*Sf srx'-i s 

»rsi,2 S2‘S*.S’- " ”” ”«-s&2i4.t5r 
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Comprehension 




V + Cf+P+ 

R + V + N + 

R + V H* N + 

R + V+ Cf + P + 



Cf + P + M + 



M + 



Xa 

Rd 

Rd 

Rs 



Comprehension Involves the ability to understand both 
literal and nonliteral statements, interpretations and/or 
extrapolation. The appearance of the reasoning factors at 
all grade levels and the Plexiblllty of Closure and Pluency 
factors seem to agree logically with the definition of 
comprehension, even though the same factors do not all appear 
at each grade level. 



Application 



APii ® R + V + N + Cf + ii'+ PVT 

Api2 = R+V+N+Cf+ Rs 

The pattern of prediction for Application is slightly 
more clear vhan that for Comprehension. Verbal Reasoning, 
General Reasoning and Syllogistic Reasoning, Plexiblllty of 
Closure and Pluency factors appear as the most important 
predictors of Application. Again, these factors generally 
agree with the definition of the behavior being predicted. 



Analysis 



Analysis is defined to be an ability wherein a 
communication is separated into its constituent parts such 
that tne communication 3.s made more cle« 3 ir*. 'PhnR 4 *v>o «»><»•;_ 




in grade nine. 



Synthesis 



U 

Rd 




tt 



IS 



m 



V + N + 
R + V + N + 
R + V + N + 
R + V + 



P + M + 
P + 

M • 

P + 



U 



Synthesis, defined as putting together of elements 
to form a new communication involves Verbal Reasoning and 
other kinds of reasoning, and Pluency. The significance of 
Number F'acility and Memory in predicting Synthesis is difficult 
to explain. The possibility exists that it is the cumulative 
effect of these abilities appearing in a higher level process. 



Evaluation 




V + N + M + U 

R + V + N V Rd 

R + V + N+ P + M+ Rd 

V + P U + Rs 



Predomin5Ant in the prediction of Evaluation is the 
number of dissimilarities which appear over grade le^cj.s. 
Consistency with respect bo Verbal Reasoning and Syllogistic 
and Deductive Reasoning provides a logical identification 
with the process, but is clouded by the ability factors which 
appear at only one or two grade levels. 



Trends over levels, forms, and grades . The following sections 
present a summary and interpretation of changes in beta weights 
which occur in the regression equations. TJ.ie method of detecting 
trends was applied only to the six factors which were common 
for all four grades and the two which were common for grades 
ten through twelve. Por each factor separately, the average 
beta weights were computed for each process level within grade 
and over fonns. These averages were then averaged over levels 
and also over grades. These averages of averages should reveal 
trends in magnitude of beta weights over grades and levels. 

The data on which these are based appear in Tables 60a, 6la, 

62a, and 63 a. 

The Reasoning factor is common to the three upper 
grades. The beta weights are substantial over all grades and 
levels. Tte average over levels was highest for grade eleven. 

The averag(i{8 over grades increase from Knowledge through 
Application and decrease from Analysis through Evaluation. 

The beta weights for Verbal Reasoning are substantial 
over all grades and levels. The averages over levels decrease 
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in size from grades nine to twelve. There is a 
the average weights over grades to decrease from 
through Evaluation, 



tendency for 
Knowledge 



Per Number Facility the only substantial weights 
appear at grade ten for Knowledge and Comprehension The 

llevtr areVeatest ?orSs-ten‘‘and 

weights, over grades, are generally small, but 
decrease in average weight from Knowledge ttoough 
Evaluation ^ slight increase in the average weight for 



Flexibility of Closure has no substantial beta welehts 

averages over leveS arfapp?oi- 

thlre L twelvl, but 

there is a noticeable drop in the weight for grade ten The 

average over grades for Knowledge is low but the weights 

remain constant for Comprehension Application 

The loadings for the Fluency factor are oulte small 
weight over levels for |rade t^n wls^riari™^ 

1 e for grades nine, eleven, and twelve were siaail and ^ 
approximately equal. The average weights for levels over 
grades were small and showed no pattern. 



substantial factor were not 

suDstanuial, The averages over levels for grades nina tnrrmtrVi 

? geuerally decreasing pattern, Lplying that 

iZtlLlT ^®"® importance as S ifvef 

increased. The averages over grades for levels ■*»evaaipfi a 

drop»ed%o\'^reellelbi*’® largest for* Knowledge, 

Wh«i= Comprehension through 

res 

« ^ Closure had small beta weights over grades 

and levels. The averages over levels for grades nine and 

a«L"fo? the®compLS?e Ivtv- 

ages for grades eleven and twelve, which were of the same 

size. The averages over grades for levels were practi^iiv 
zero except for Knowledge and Evaluation. Practically 

was commM®oSf Verbal Transformations, 

was uommon only to the three upper crades Tf“<^ hia^-o 

were generally not substantial ?or !^ve!^or g?adls 

largest average over levels for grades appeLfd at erafe 

Sant ^r ainivll^®'’ ^®’®^® 



Discussion 



presumed that sixteen psychologically pure 
factor tests could be extracted from the thlrty-seven^cogni- 

these i,Zll bf 

oomon for all grade levels. But the factor analyses revealed 

for fl?? Lfi* he extracted which werl comon 

for all grades and that two others could be extracted which 
were conmon for grades ten through twelve. At each grade 

extracted, so at any grade level, as few’ 

®® 2?"^ factors could be specific to the 

coii?)08ition of each of the eight common 
factors (six at four grade-levels and two at three grade- 

*^°® °“® S*’®<J®-level to the next to 
the extent to which we had anticipated. 

la nr»ftHaK?« Obtain the expected number of factors 

Is probably attributable in part to the restriction of rano*e 

tests, because some were too difficult for 
the youngest age groups and too simple for the oldest age 
because of the possibility that the elemLtfl 
are organized differently in students of different 
ages possibly because of maturatlonal or experimental differences. 

i-fwa failing to obtain the factors in 

imLrtS generality over grades seriously 

Impeded the Interpretation of the regressional analyses which 
were intended to reveal the similarity of procesf scores over 

d??f«S£„?"l®'‘“'^® *‘>® ®*’“8®® the factor ItrScture of 

different process scores within grade, etc. 

a given structure for 

woula be similar across contents and possibly 

Jt was our unstated expectation that (a) if 
all factors related to all level scores, then there would be 
changes in the beta weights for each of the factors 

relate sienificantTv^?^*^* factors did not 

level score, then as level of 
progress Increased then new factors would appear in the 

equation. In short, the first hypothesis is that 
all iacvors appear at all levels but at each level the 
composition of thsm differs and that tL chLges In welghti 
for a given factor would be orderly through the levels The 

®® level increafis tte clmp?;xl?f 
in t'h£ ® consequence additional factors will appeL 

in thl eluatioirfoS“«?i°l^? f a given level and will rlLln 
^' 4 a ail higher levels of process. Pranklv 
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obvious that our failing to obtain the sixteen 
which we had anticipated and our obtaining the factors 
<5rastically reduced the chances of determining which 
of the previously mentioned hypotheses about the factor 
structure of levels was more tenable. But even without regard 
to the factors which were obtained, the results of the simplex 
and circumplex analyses made it rather evident that the 
investigation of the psychological sti»ucture in terms of 
elemental aptitudes would be rather difficult methodologically 
and that whatever results were obtained would be equivocal, 
peclflcally, the factor analyses which revealed the presence 
of content factors clouded the relationships between aptitude 
fnd process scores. The simpiical analyses revealed for 
several forms and grades that Synthesis and Evaluation might 
more properly be regarded as coming between Knowledge and 
Comprehension in an ordering according to empirically deter- 

complexity. This information was damaging on two counts. 
First, chat suggested mlsorderlng was not consistent over 

implied that the several forms had 
ability compositions for the same process and/or 

Jo! abilities within individuals were 

associated with their age and grade placement. Second, there 
^pxlcaticn that some px-ocess levels, specifically 
Evaluation, were deficient inasmuch as the 
the results of the simplex analyses could 
explainea on the basis of item deficiencies 
which were kno^ or suspected prior to the analyses. The 
circumplex analyses suggested that the Knowledge and Evalu- 

regarded as the weakest of all that were 

^ regression analyses 
J^eveal systematic changes in factor structure from 
level to level sc long as a particular order was forced on 

contents. In summary, the equivocal 
resul..., of the regression analyses were not unexpected. 

Nevertheless, the results do reveal some consistencies 

Reasoning, Reasoning, and Number 
xoad substantially at nearly all levels. Memory 
heavily on Knowledge, Synthesis and 
Evaluation. (This expectancy was generated on the basis of 

analyses.) Speed of Closure 

had greater loadings on Knowledge and Evaluation: again in 



D. Summary 



section dealt with testing hypotheses about the 
hierarchical structure of the taxonomy and the generality of 
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of thrs!f psychological structure 

ttT!?? hypothesis about the hierarchical structure was 
tested with two sets of data. Mean scores from subteqtq 
representing the processes were examined to determine* if 
^creased as the taxonomic level of thrprocefsirinrr.pLo5 ^ 
results were generally supportiverhowever^ 

at™wJ^|^adB"lewl^orth^R *epe reversals 

;?Sv:sinnSrSaSs gi:.Vaf‘ 2£’ r 

S S,£.S;„‘^SS'i?*eSM.'S* T"’" “ a»SSsi. 

S-S„-52 = 

I^e^aratfgSLffevelffof-hrL^r^^^^^ 

The AtomirSteuctarriofJ^^^ Earthquake test. . 

Srf Mi -SHA. 

Knowledge and'compfehenslof anf f Placed between 

was plaled betweeflnalvstfanf Evaluation 
Structure form/syntSesif 

Plaeea be,.... aroSShSXrS |SS |S2 l.v.l 

evidence Is °hS^the°hTOOthesi sets of 

structure of tte taLSff the hierarchical 

disconflrmed. However the\enri»f completely confirmed nor 
support the hvooth^iB evidence Is to 

because some of the data which* are"«?"S^ f further strengthen« 
hypothesis can be ascrlbed1^^tS!i*\nS Items. 
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„ The second hypothesis dealt with the transcendence 

of <Jata werfused ?r 
validity. The six processes scores from 
each of the four forms for each grade level separatelv were 

factor analyzed. The unrotated factor 
^trices were then Inspected for the presence of process 
factors which appeared over the four forms. These analvsp*? 
revealed the presence of a general fact™ iid some S 
or process-content factors. Factors associated with each 

matrlces^e consisted of Intercorrelatlon 

forms at each*'ievM^of'**’*®?*i scores for the foiu? 

twentv ^o»ir separately. Each of the resulting 

The reauirLerJ were subjected to olrcumplex analysis, 
total perfect clrcumplex is that c^umS 

retlcaliv^dea?£?Mf*"®?“ obtained values and the theo- 

ITH r^g^^d^I 

matrices were thosi forlnSgr^d^^^aar®'®'®"* 
such thar*th£'^w«th by the two sets of data was 

Tp^obihr?;; tSe I 

flfder4mfn^nrthfsKr®"^“?^ 

SrS^S.??r~ ^ 

psycholoScal^^ructurf the 

LrtSr cImpoLwon of each of tSf f identifying the 

LtfL®"siflftherwerf regarded af f f 

upper three grades. But nonf of ?hlse"li^gt“Srfwaf 
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Identically determined at all grade levels r The remaining 
factors were common to two grades, specific to a gi»ade, or 
were uninterpretable. 

The nature and number of extracted factors were different 
from the expectation and seriously in^eded the interpretation 
of the regression analyses which were subsequently calculated. 

The thirty-seven tests were chosen from the KIT on the assunm- 
tion that they would yield sixteen psychologically pure factor 
tests. It was also assumed that each of these factors would 
have highly simil6u* compositions over grade levels » The 
obtained factors discredited both assumptions. 



Each student's score on each of the six subtests from 
each of the four taxonomy-type tests was predicted from his 
t©n factor scores • The resulting regression equations were 
then analyzed to determine if the same factors appeared for 
each of the test forms at each grade level, whether there were 
systematic changes in the equations for process levels within 
and oyer grades, etc. No clear antecedent hypothesis had been 
formulated about the probable results. However, it vas expected 
uhat one of the following statements would be descriptive of 
^2® factors will load on each subtest (process) 

of all four test forms at all grade levels, and systematic 
chafes in the beta weights will be noted from the Knowledge 
subtest through the Valuation subtest and systematic cheuiges 
in beta weights will be noted over grade levels. The competing 
expectation was that the regression equations would contain 
m increasing number of significant factors from Knowledge 
through Evaluation and that over grades the same order of 
appearance and continuance of factors in the regression equa- 

these postulates was 

verified by the data. Some of the common factors had stable 
weights over grades and systematic changes over levels and 
vice versa, others held relatively constant values over levels 
and grades 3 and some changed over both simultaneously. 
Nevertheless, certain apparently consistent patterns did emerge. 
Due to the unsatisfactory number of common factors and their 

composition over grade levels, the patterns 
which did appear are regarded as being undetermined but 

suggestive of the probable valuo of more rigorous subsecuent 
analyses , ^ 




VII. SUMMi»Jiy AND RECOMMENDATIONS 



s6c1/lon contfilns sl 8uniin&x*v of lihe 

about where future research 

^tivitles might be pointed to realize the greatest gains 
mese recommenaatlons spring from problems wMch wos^ 
during the project and were not resolved 



A. Sunmiary 



Problem 

4 .V,- major purpose of the project was to determine"^ 

orLS'?f olassincatlon schemr X 

presented In the Taxonomy of Educational Obleetlvas 
Handbook I ; CognlFlve Domain J ^^c^^ives, ^ 

system or taxonomy is intendefi-^ 
for organizing educational objectives which describe 

“'«s?sM Of s??maJor , 
-evels; Knowledge, Comprehension, Application. Analvsir > 

cognitive processes which 

appear in the taxonomy. The imputed order is from 
Itoowledge, the simplest, to Evaluation, the most comolex 

cha^acterlstirrefeS cumulative'^ ’ 

Lscribirat^ill contains all processes 

, , an levels which are placed lowei* 

the structure. Therefore, the Analysirievel 

complex than Synthesis and Evaluation; It Is more complex 

uhan foowledge. Comprehension, and Application* and it 

Includes all processes that are Implied bficnSwltdL 

Comprehension, and Application, and it alL iScluSs’ 

novel processes with respect to those In the lower !evels. 

The phenomena which are classified bv this svRfjatnX 
^®8ponses (behaviors) which test lteL^(ln th^ O 
cognitive domain, as contrasted to the affective ^ 

psychomotor domains) are intended to evoked ^ S 

4 4 implicit model of a response to a t*PR^ ■H’jsm 

^!.s, in its simplest form, that the response 3 s tha 

interaction of the application of a S? prwesl to an 
unit of subject matter content. Process to an 
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The taxonomists state their belief that the 
cognitive processes, which are described in the taxonomy, 
transcend content^ l*e*, cognitive processes described by 
Comprehension constitute mental or cognitive operators 
which are equally applicable to many contents* 

The Taxonomy was published in 1956 and since that 
time it has served to structure the conceptualization of 
educational problems and activities. It is used to 
classify educational objectives, to formulate the 
specifications for achievement tests , to develop sequential 
training programs which hopefully lead to the attainment of 
Increasingly complex behavior patterns, etc. Despite 
these significant usages , few studies appear in the 
literature which deal pointedly with the validity of the 
^ taxonomic structure. This project v/as addressed to that 
topic. Three questions were considered. 

1. Can empirical evidence be found to support 
or refute the ImiDuted hierarchical structure? 

2. Can empirical evidence be found to support 

or refute the imputed generality of the several cognitive 
processes? 



3« Can each level of the structure be explained 
by more elemental cognitive aptitudes, and, if so, do the 
combinations or numbers of them change systematically 
from one major level to the next? 

The question or hypothesis about hierarchical 
structure was investigated with two sets of data. Mean 
scores on the processes (levels of the taxonoii^r) were 
examined to determine if they decreased as the complexity 
of the levels InoreaBed^ The intercorrelation matrix of 
process (level) scores were examined for the presence of 
slmpllcal structure as described by Guttmaii’s Radex Theory. 

The second question or hypothesis about the 
transcendence of process was Investigated by two sets 
of data. The intercorrelation matrix of process scores 
gathered over several contents were examined for the 
presence of clrcumplex structure as described by Quttman’s 
Radex Theory. These intercorrelation matrices were also 
factor analyzed and the factors were examined for 
generality over content. 

The third question, which dealt with the psychol- 
ogical structure of the taxonomy, was cast into an explora- 
tory study. The exploratory study involved generating 



I 



I! 



165 



I 

! 

I 

f 








I 




orthogojictl cognitive aptitude scores and determining 
their regression weights for each of the processes 
(levels) within and over contents o 



Procedure 



Special tests were constructed for the study ' 
because none was available coaunerclally or from other ^ 
investigators which would yield scores corresponding ^ 
to the levels of the taxonomy, ^ 



Pour taxonomy-type tests were constructed for 
use with ninth- through twelfth-grade students. Lach 
of tnem consisted of six subtests corresponding to the 
major levels of the taxonomy,- The tests. were of the 
reading comprehension type in that a reading passage 

content appeared in each 

test booklet and the test items were based on the 
content of it. The reading passages were selected on 
the basis of their probable Interest value, probable 
ease of comprehension, and their unfamiliarity to 
s,.udents. The latter two specifications are important 
vecause it is necessary that concent mastery of students 
be relatively equal so that score variability will 

mastery of the cognitive processes. 
Of the four passages which were finally selected, two 

0^1 science content,, the Lisbon Earthquake 

and btages of Econonic Growth 5 and two dealt with 
science content. Atomic Structure and Glaciers. 



Each test consisted of two parts. Part A 
included the Knowledge, Comprehension, Application, and 
^ialysis items. Each of the subtests consisted of 
twenty four-choice items. Part B included the Synthesis 
and Evaluation items. n,ere were five free^^rMponsf 
items and ten free-response Evaluation items, 
All sub oests had a maximum possible score of twentv 
points. The administration time for each part is ^ 
fifty to sixty mlnuces. 

Preliminary forms of each of these taxonomy-tvoe 
tests were pretested in a minimum of two versions? 
Revisions were baaed on observations of student per- 
formance during test administration, their reactions to 
structured questions at the conclusion of the test 

^^‘^ 3 tions they asked during and 
after the test administration, and on statistical 
analyses of their responses. 



o 
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The tests appear in Appendices A through D. 

The cognitive aptitude tests were chosen from the 
Kit of Reference Tests for Cognitive Factors . Thirty-se.en 
of them were selected for use in the study. 



^st administration . Taxonomy-type tests were administered 
to ninth- through twelfth-grade students in ten Florida 
schools from five county school systems. Collectively the 
students represent a slightly above average group with 
respect to mental ability as determined by national norms. 
Tests were administered by project staff members with the 
assistance of local school personnel. Prior to testing at 
any school, orientation sessions were held for local 
teachers and administrators. The majority of students 
were administered all four taxonomy-tyne tests, w>»ich 
required eight hours of testing time. ‘No student "was 
administered fewer than two of the forms. 



The thirty-seven cognitive factor tests were also 
atolnlstered to all students in one of the schools. 

Administering these required an additional eight hours 
from each student. 

Approximately 1,600 students at each of the four 
grade-levels were administered the taxonomy-type tests, 
and approximately 275 of them from each grade level were 
administered the cognitive reference tests. 



^est scoring. The forced^ choice items of the Knowledge, 
Comprehension, Application, and Analysis items were scored 
electronically. The free-response Synthesis and Evaluation 
items were scored by a staff whose members were selected 
on the basis of quail fi cat ^ '^ns resembling those of a class- 
rcom teacher^ and then trained In the scoring procedures# 
Th>,s unusual qualification was specified to demonstrate 
that classroom teachers could score these items if called 
on to do soo Complete scoring instructions for each 
Synthesis and Evaluation item appear in Appendix E. 



The cognitive aptitude tests were scored by a 
trained staff who had previous experience in scoring them. 

Quality control checks were run intermittently on 

both scoring staffs. Data on rater reliability appear In 
Appendix E. 



o 
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Anai^es. To test the hypothesis of inverse relationshlo 

taxonomic levels mean scores 
for each subtest for each grade, nine through twelve 
were calculated. Means were cohered fo^el^h tesTform. 

The hypothesis of slmpllcal structure was 

devised by Kaiser for scaling 

used^o select computing a statistic which can be 

used to select the order of variables In a matrix which 

will most closely approximate a perfect slraDlex Tht^QP 
Malyses were completed for each form for eacrgraS l^d 
for each fora over all grades. ® ° • 

^ hpothesis of transcendence of orocesses was 
tested by factor analysis and Outtman’s cirowDiex 

each grade^ nfrp ^*4. ^^^^ses were calculated for 

comblnS! ’ ^ through twelve, and for all grades 

nnrt ^’cl^tlonship between taxonomic level scores 

scorll fo^eaS gradr cognitive aptitude 

ao?itu%'"'°"® "®"® 

s%irF 

Ss°?^ "®'’® pre^^crff^rsf 









hypothesis^ hlerL-“?S®stSw ^°Por''S?T ?° 
of the social science forms for grades ten, eiewn^^^®® 
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to Slmpllcal struotwM^d*lt wS®<j"^eren* 

feowledge 

.drawn th°aS I" 

Jfxono^!“‘’‘’°^ hierarohicaX struclu^'of t\e 

r£.:2ir‘”c H“ 

s; ssss‘S'H,?;iSSLfiK;,j*;f5„“ «»rf.. 

associated with Knowledge, Synthesis and Evsinffw^® 
appeared to be common over fo-mr^d 

factr;nf?y:L“fsu?L w^re s^rSullv^ 

impaired because unrotated factor matrlcL had ?« 

th^faclow whlcS wire 

extracted were mixtures of content and orocess 'Th#a 

feSsHH SSsS* £“ss sllr r 

cominon factors (six were common to four grades and^wo 

of factorR*^nl?frh^®'^' *? emerge, and because the majority 
Sere Malysls of the taxonomy-type tests ^ 

clrtail Mttl,.ll process. Nevertheless, 

o««i« emerge which suggested somewhat 

systematic changes in factor structure ove'" oroces" le**«i*’s 

oTthTo1lioufli;rfol°mr^^^^^ 

lf'*thfll«rnrtS^'’lf^?l^ taxonomy-type tests. SS §“Lse 
extracted* ^ nature of the taxonomy factors which were 



B. Recommendations 

The recommendations which are oreaent'P/i vk^tva &v>/>sa 
from problems which were encounterlfdSSirthl rtllv 
Many of the® were not anticipated, none o?®tte| 
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satlsfacotrlly resolved, and it seems that all of them 
deserve concerted study prior to executing further 
investigations of the construct vallditv of i-hp 

“I s?r* “? 

b^y“f the TOport! "scussions of them appear in the 



Knowledge as a Process 

Some doubt exists about whether Knowledee the 
lowest level of the taxonomy, should be regarded as the 

4.U this Questxon arises because the measurement of 
the process of recall seems to be indivisible from the 
measurement of stored content » The problem is fundamentally 
important because validation studies of the taxonomy are 

gathering data about the execution of^ 
of all of whom have complete mastery 

relev^t content. When a student fails a KnowJldee 

content not been stored? PT»«*5entlv 
available me^urement techniques do not enable d'scrim-^ 
inatlng one from the other. The consequence of riorhav^nv 
thxs discriminative measurement partial iv 4 -k ^ 

exciSveiv'^fo '’® attributed 

exclusively to Inadequate mastery of the relevant nmrvooa 

In other words, process score varlabintv'^wf»K?^^^ process, 
component Of vartability^^^oS taowLSf nf * 
presence decreases the validity of the process data anr? 
impedes efforts to. validate the structure of Ihe tL^omy. 

refined measurement techniques are 
Self *t?ref thf coStnt has 

Of thf «Sni!uf rm!|ir?nf t^^ %lTu.T 

differing in thrcSefgLen i^he 
stems ^d have found that item difficulties varv^ 

equli“^§suL“o the^X^lf^'**’ “ ^ad 
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Item Analysis Data 

Guidelines for the legitimate interpretation of 
item analysis data from taxonomy~type tests must be 
established. When dealing with conventional tests one 
usually strives to maximize the number of discriminations 
by selecting items at the mid-range of difficulty and, if 
several sabtests are involved, to maximize the homogeneity 
of each and to minimize subtests intercorrelations. These 
procedures do not seem to be applicable when using item 
data as a step in test refinement. 

A taxonomy-type test will undoubtedly contain 
subtests (or a mass of items which are scored according 
to process keys) which correspond to the levels (Processes) 
of the taxonomy. According to the claimed structure of 
the taxonomy, these subtests will var*y systematically in 
eonplexity. Consequently, one can probably expect that as 
level increases then mean item difficulties will decrease. 
Furthermore, subtests vjill be intercorrelated and these 
coefficients should decrease systematically according to 
the relative remoteness in the taxonomic structure of the 
subtests which are correlated. 

Therefore, it seems sensible to devise theoretically 
a set of expectations about the desirable range of item 
difficulties for each subtest and the pattern of item-subtest 
correlations which an item should exhibit over all subtests. 

If one unwittingly applied conventional item 
analysis aiid selection techniques then he will certainly 
violate the structure of the taxonomy and produce a test 
which probably will yield invalid data. 



Triangular Bivariate Distributions 

Assuming the structure of the taxonomy, then it 
probably follows that bivariate distributions among 
subtests will be triangular. The lower level subtest 
will establish the ceiling for scores on the higher level 
subtest. The majority of bivariate distribution which we 
plotted from our data exhibited this characteristic. Its 
presence raises questions about what measure of association 
can be calculated legitimately from such data. We 
acknowledge that our data had this characteristic; 
nevertheless we calculated product-moment correlations 
because we could not Identify any measure of association 
that could be applied legitimately to these data. We are 
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unaware of the gravity of applying an inappropriate 
statistic, perhaps the development and en?>loyment of 
legitimate techniques of measuring association will 
eventually lead to discrediting the results which are 
presented in this report. 

The comments in this section and the preceding 
one on item analysis data are based on the assumption 
that taxonomy-type tests will contain the relevant* 
content on which the items are based. Under this con- 
dition, means will probably decrease as item levels 
increase and pairs of subtests will have bivariate 
distributions. In short, complexity and difficulty 
will probably be similar. But if content is not supplied 
wluh the test items, then Guttman's differentiation of 
complexity and difficulty must be taken into account and 
it is likely that our suggestions and data will be 
irrelevant. 



Intended and Actual Processes 

The taxonomists clearly stated that the 
phenomena to be classified by the taxonomy are the processes 
wnich test items are Intended to evoke. 0»ir study is 
based on the responses which items actually evoked. 
Consequently , if one takes a very narrow view of the 

f * then our study does not deal with the 

validation of the taxonomy. However, we believe that 
if the taxonomy is used as a guide in structuring 
educational experiences then it must be shown to be 

descriptive of eaplrical phenomena or corroborated bv 
them. ^ 



The more important question seems to be about the 
tenability of the assumption on which our tests were 
constructed^ specifically, that a correct response to an 
item Implies use and mastery of the appropriate process 
and that an incorrect response indicates the contrary. 

Aq believe that if the logistical problems v/ere of no 
consequence then the most pertinent data wh3.ch could be 
gathered for validating the taxonomy would be th^ 
recordings of oral problem solving processes by students. 
We definitely regard our data as second best from the 
methodological st^dpoint but perhaps the most relevant 
which could be collected from masses of students when 
judged from the practical standpoint. 
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The Evaluation Process 

The Evaluation process as described in the taxonomy 
is one which deserves further study. First, Evaluation in 
terms of external criteria, one of the two sublevels, seems 
to introduce content which is alien to the content on 
which the t6St Items are based* Second^ the stud5.es by 
McGuire suggest that Evaluation according to internal 
criteria is a process which is less complex than is 
Synthesis. We found it to be the most difficult process 
for which to write items and our analyses reveal that it 
was the one which roost frequently did not conform to the 
hypothesized order of the levels. 



Norms for Taxonomy-type Tests 

If taxonomy-type tests are constructed and come 
into wide usage, then it will probably be necessary to 
devise some meaningful derived score for the scores which 
the teS(/ yields. The problem is quite coo^lex and probably 
cannot be solved by current norming techniques. The derived 
score v/ill have to bo created with due regard to the 
following points. ?irst, a taxonomy-type test will probably 
consist of a series of contingent tests in which the attai ied 
score on a lower level test establishes the maximum score 
on the test of the next higher level. Second, since 
perfoimance will decrease as level of subtest increases, 
the raw score distributions will become increasingly skewed 
and on the higher levels the frequency of "zero” scores 
will probably be substantial. Third, the raw scores seen 
to have both ipsative and normative characteristics. Th<* 
score distribution on any taxonomy subtest (which will b<» 
a power ;est) represents the distribution of the persons 
over that trait, ^he other hand, a person’s scores 
over the subtests .lot independent because a given 
subtest score probwj..y establishes the celling on the 
score wh,i.ch might he attained on the subtest which appears 
next above in the hierarchy. 



Item Types 

X. ^ attempted to prepare items in the multiple-choice 
format for all levels of the taxonomy. We could not writ€j 
multiple -choice Synthesis and Evaluation items which were 
regarded by the pi*oject staff as likely to evoke the 
Intended process. The staff seemed to classify as Analysis 
multiple-choice items which were written for the Evaluation 
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process* Multiple-choice items which were written for 
Synthesis were frequently classified as Analysis or even 
lower in the structure. As a consequence, we adopted 
the frse-response format for Evaluation and Synthesis* 

The scoring time required for responses to these items 

great to infer that taxonomy-type tests 
which include free-response items will not be as feasible 
for mass administration as are the typical achievement 
tests, the items of which seem to be confined to the three 
lowest levels of the taxonomy. Because the Synthesis and 
Evaluation processes are critically important and because 

u predictable unacceptance of survey instruments 

which include free-response items, it seems especially 
appropriate to conduct research on items writing techniques 

might make these processes amenable to 
multiple- choice assessment. 



Pyramj.d Tests 

If a student fails to answer correctly all 
Knowledp Items which appear in that subtest, then the 

higher level subtests are of 
i because one does not know whether to 

atcribute these subsequent failures to lack of stored 

Inability to recall infomation which is 
it appears that a student’s mastery 
he assessed only when the test items 
available. It seems theo- 
prepare sizeable numbers of items 
process^levels and all based on the same 
content, xf these items could be apprvopriately 
according to the level and the bits of content 
require, then a student could first be exposed 

In ® ^^sls of his responses 

One could determine the precise elements of 

available for use. On the basis of this 
information, items could immediately be selected for all 

whlcr"e"fo»r"o? r^q;5rrc;;;t1nt taowLge 

test*^ notion of a pyramid 

test. Undoubtedly, each test would be unique, beine 

patterned especially for the student. The logistics of 

the technique would require that all items and their 

placed in a computer storage and that 
the studeno interact with the computer through an input- 

and that the test be 
basis of the student’s responses to the 
first set of items which is presented to him. 
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ATOMIC STRTJCTOiiE 
Directions 



This is a test of your ability to apply skills 
and understandings which you have been learning since you 
entered school. You will be asked to read a passage called 
Atoinic Structure’* and then you will loe asked to answe* 
questions about it. You may refer to the passage any time 
during the test. 

Your answer must be marked on the answer sheet which 
has been provided. Do not make any st;ray marks. If you 
make an error, erase it coB5)letely before me-rking your new 
answer. 



Make no marks in the test booklet. 

The following is a sample question to show how 
your answers are to .^e marked. Study the san*i>le and if 
you have any questions raise your hand. 

SAMPLE ON S'iPARATE ANSWER SHEET 

1. The article you will read 
is about 

1. atomic structure 1. 1 «k. 2” 

2. northeast floods *" 

. last days of World War II 
. the Spanish-American War 

You should answer as many questions a&' you can. 

Do not spend a great amoxmt of trime on any one question. 

If you are in doubt about the answer a question, then 
guess. Remember that you may rofer to the reading passage 
at any time during the test. 

R.P. Kropp and H.W. Stoker, Editors 
Department of Educational Research and Testing 
and Institute of Human Learning 
Florida St, ate University 
Tallahassee 

April, 1965 
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This experimental test was constructed as part of a 
research project supported by the U. S. Office of Education 
under Contract Number 0E-4» 10-019, Project Number 2117. 



The copyright holders of the materials which appear 
^2 passage of the test kindly permitted the 

project staff to use the materials e:q)erimentelly and the 
holders subsequently extended this permission to all persons 
who Wj.sh to use the experimental version of the test fo’* 
research purposes. 
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ERIC 



ATOMIC STRUCTURE 



Mendeleef now arranged the elements into 
Pri hv lithium (at. wt. 7}, and follow- 

^ boron (11), carbon (12), Nitro- 

fluorine (I9). The next element, 

^ the order of increasing atomic weight, was sodiim 

This element resembled lithium very closely in both physical 
^id chemical properties. He, therefore, placed irbelof 
lithi^ in his table. After placing five more elements hP 

rine *^mdS°wMnh had properties very similar to fluo- 

rine, under which it miraculously fell in his list. In this 

way he continued to arrange the remainder of the elements 
When his list was completed, he noticed a most remarkable* 
order. beautifully the elements fitted into their 
places. The very active metals lithium, sodium, potassium 
rubidium and cesium fell into one group (No. I) The ^ 

iSinf non-metals, fluorine, chlorine i b^mine and 

iodine all appeared in the seventh group. 

, . mendeleef had discovered that the properties of thp 

?ha? functions of their atomif w^^h^s, " 

flf’fPY* properties repeated themselves periodically 

elements. What a simple law he had a-«scover- 
astonishing fact. All the atoms in 
^ ^ibed with oxygen, two atoms to one, A13 the atoms 

elementrS"Lom“?TT"“i^ with oxygen, atom for atom. The 
elements in Group aH joined with oxygen, two atoms to thrpp 

mStf " prevailed in thf remainin^groups 

^ in bhe rea^.1 of nature could be more simple‘s To 
toow the properties of one element of a certain group was to 
Imow, in a general way, the properties of all the elements in 
try student ^ saving of time and effort for his chemis- 

d«nop^* table be nothing but a strange coinci- 

the rarest of ®hP 2® studied the properties of even 

eratu?r?L?^h»^LI^ ? ”! f®”Searched the chemical lit- 

elemm® misplaced an 

eiemeno t^ f^o iii with his beautiful edifice. Yes here wp<? 

tellurium, 128, to agree with his schpmp 
pu looked at his Periodic Table of the 

pSr the coinage If a 

between ?23 ^d®126 and no^ 

heresv tat determined. Here was downright 

heresy, but Dmitri was not afraid to buck the established 
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present, he placed the element 

weim Y^ra ^’^^se atomic 

later his action was upheld, for further 

cor?^ct^ "^^irwas^Lf position of tellurium to he 

tlonslA magnificient prognostica- 

Perhaps Mendeleef ‘s table was now free from fioi^e 
scorn. Cnde^Sf mlSl'b^a^lnoS^ tomato ChKo^fiLes 

o. ohe queer Russian was almost uncanny^ta SnccO^cyi 

Mendeleef was still to strike his cresteoe 
Here were places in his table which were vacLt^*^Were twl,, 
always to remain empty, or had the e?,foltro“m^ failed af 

spLes? riess®te?reofd^f belonged tolhSe 

conclusion thm- +h<o®Df^ person would have shrunk from the 

sfss: -J5 s s-gr-i' 

titanium HI was a gap between calcium and 

Must r^;mbfe^^o%il°=|SSlar^L" SoroTwSSf plr^ff 

num. And, finally he fou^d Sr^plce Ltween arLn^ 
eka-aluminum which appeared in tb'; fourth grour Stoce 
positi^ was below the element silicon, he called it pL^o?h 
con, ^us he predicted three undiscovered elements and"iAft” 

5iH» -S'?- K1S- 

in>nt8 -in places for more than sixty ele- 

the other missLg®buildtog Mocks^f ?bf ^ive^f;? "$^L?y 

EngliK,“fo!Lwlig^fciufXa~ 

group Of elements of which even t“ssL'=tel n^^LA^ILed 



AS-5 



These elements constituted a queer company— the Zero Crout>, 
as it was later named. Its members, six in number, are the 
most unsociable of all the elements. Even with that ideal 
mixer, potassium, they will not unite. Fluorine, most vio- 
lent of all the non-metals cannot shake these hermit' ele- 

their inertness. Moissan tried sparking them 
with fluorine, but failed to make them combine. Besides, 
they are all gases, invisible and odorless. Small wonder 
triey had remained so long hidden. 

Besides these six Zero elements, seventeen other 
were unearthed, so that, a year after Mendeleef died 
elements were listed in the Periodic 
Table. Table 1 shows Mendeleef *s table in I87O0 

Two years after Mendeleef was laid beside the 
grave of his mother and son, Pattison Muir declared that ’’the 
future will decide whether the Periodic law is the long 
loo.ced for goal, or only a stance in the journey; a resting 
place while material is gatheied for the next advance.** 

V Periodic Law weathered 

Throughout the years the current Periodic 
Table has had many similarities to Mendeleef *s table. 

Table 2 , the current periodic table, reflects one major 
change. For many years the atomic weights of elements have 

of oxygen - 16 . 000 ; this table 
liable 2 ) is based on the weights of carbon - 12.000. 

V 4 T.U Current Periodic Tables, such as Table 2, are 

concept of atomic number rather than atomic 
wsiglite The pi^;sent Periodic Law can be stated thuslv; The 
prt>pertxes of the elements are periodic functions of the 
atomic numbers. Table 2 makes use of this concept and also 
5 pfv? o® concept of increasing energy. To illustrate: In 
Table 2, oxygen (0) - at. wt. = l6.0; at. no. ~ 8; Group «VI. 

every atom has associated with it a charac- 
berisolc atomic number and a characteristic atomic weight. 

4 4. atomic weight of an atom is the total weight 

pLu protons, electrons, and neutrons. 

^ 4 bas a weight of one (1); each electron has a 

weight of zeTO (0); and each neutron has a weight of one (1). 
yie rea.son the table based on atomic weight and the tabl-® 

nxmlaeT are similar is that the atomic number 
is equal to the number of protons in an atom. 



parts of an atom have 

cr^racteristic ele^^trical charges. Protons are positive f+), 
electrons are negative (-), and neutrons are neutral (0). In 
eve^ ^^ent there are equal numbers of protons and electrons . 
^ere are situations when ai* atom does not have equal numbers 
^ protons; when this occurs, the atom is called 



Characteristics of the Particles of an Atom 



Particle Weight Charge 



Proton 1 +1 
Electron o -l 
Neutron l o 



Adapted from 

"Mradeleef" from The World of Mathematlna hy 
|l9-S)3l”^’ Vol. 2, Simon and Schustef; Mew lorS7T556, 
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1. Mendeleef placed the chemical element sodium (Na) in 
group 

(K) 1. I 

2. II 

III 

4. IV 

2. Which pair of elements is in the same periodic group? 

(K) 1. Sodium, cesium 

2. Sodium, chlorine 

3* Bromine, rubidium 

4. Oxygen, carbon 

3» Mendeleef discovered that the properties of elements 



4. 



6 . 



7 . 



(K) 



1 . 

2 . 

1 : 



were periodic functions of atomic numbers, 
were periodic functions of their atomic I 
weights . 

were depsnaent upon temperature and pressure 
could not be ordered. 



Atoms of which group unite with atoms of oxygen in the 
ratio of 2 to 3? 

(K) 1. I 

2. II 

3- III 

4. IV 

All elements in the same group have similar 
(K) 1. atomic weights. 

2. general properties. 

3* atomic numbers. 

4. specific properties. 

How many elements are in the Zero Group? 

(K) 1. 3 

2 . 6 

3. 9 

4. 17 

Which element is known as the ideal mixer? 

(K) 1. Hydrogen (H, #1) 

2r Oxygen (0, #8) 

3. Flour ine (P, 

4. Potassium (K, #19) 



e symbol (#) la used in several questions in this 
test, This symbol stands for atomic number. 



8. According to the passage, elements that do not 

combine with any other elements belong to the 
(K) 1. Second Group. 

2. Gas Group 
Zero Group. 

4. Metal Group. 

9. The Zero Group elements might be described as 

(K) 1. elements with ..atomic weights of zero. 

2. highly active gases. 

3* highly active non-metals. 

4. invisible and odorless gases, 

10. The chemical world has had the advantage of a Periodic 
Table for approximately how many years? 

(K) 1. 50 

2. 100 

3 . 150 

4. 200 

11. An atom with unequal numbers of protons and electrons 
is 

(K) 1. a neutron. 

2. an electron. 

3. an element. 

4. an ion. 

12. In Table 2, which of the following symbols is used to 
indicate s-n element in which one outer shell electron 
drops bach to an unfilled inner -orbital? 

(K) 1. d 

2. triangle 

3. black square 

4. Roman numeral 



13. 



14. 



indicate 


a non-metal? 


(K). 


1. 


P 




2, 


arrow 




3. 


bar 




4. 


white square 


Neon 


(Ne) 


has an atomic 


(K) 


1. 


10 




2. 


11 




3* 


1": 




4. 


l6 
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15. CobaXt (Co) has aii atomic weight of 

(K) 1: '58.9 

2. 52.0 

3^ 83.8 

4 * 101.0 

16. In T6ible 2, rhenium (Re, #75) is a member of Grour> 

(K) 1. Ill 

2o IV 

3. VI 

4. VII 



17. Iridium (Ir) has an atomic weight of 

(K) 1. 186 

2. 190 

3 o 192 
4. 195 

18. Table 2, astatine (At) is a member of Group 

(K) 1. m 

2. IV 

3. V 

4. VII 

19. In Table 2, most of the inert gases appear in Group 

(K) lo 0 

2. I 



20. Table 2 indicates that sulphur (S, #16) is 
(K) 1. a yellow powder. 

2. a ncn-metal. 

3. a typical element. 

4. inert. 



21. Mendeleef thought he had misplaced iodine and tellurium 
in his table because 

(C) 1, the accepted weight of iodine was less than 

that of tellurium. 

2. their known properties were not the same. 

3* their known properties were pne same. 

4. the accepted weight of iodine was more th€ui 
that of tellurium. 



I 
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t 1 



I 

I 

I 



2?. 



r 



24. 



25. 



26. 



I 

s 



27. 



According to Table 2, the numl^^r of electrons occupying 
orbitals in the element aluminum (Ai, #13) is 



(C) 



1 . 

2 . 



5 

12 

13 

27 



23. What is the relationship between 
(An) A. Group ntunber, and 

B. Atomic number 

1. An increase in A is usually accompanied by 
an increase in B. 

2. An increase 'in A is usually accompanied' by 
a decrease -in 

3. An increase in A is usually accoB^anied by 
either an increase or decrease in B. 

4. A is determined by B. 



Which of the following best describes Mendeleef's atti- 
tude toward his findings* 

(Ap) 1. He would apply his theory regardless of the 
consequences to his reputation. 

2. New fields of research were open to chemists. 

3. The relationships he had discovered were 
possibly coincidental. 

4. The results would probably hold :rue even 
though his work was largely guesswork. 

The correct ordering of elements according to increas- 
weights is 



(C) 



1 . 

2 . 

1 : 



Cl 



9 Na. 
Na, Cl, F. 
F, Na, Cl. 
Cl, F, Na. 



Wiiich of the following is the best estimate of the year 
in which Mendeleef was bom? 

(An) 1. 1800 

2. I8l0 

3. 1840 

4. i860 

Mendeleef *s table can be best described as 
(C) 1. a chemical table arranged in increasing 

atomic numbers. 

2. a table of chemical elements arranged in 
a precise order. 

3. an orderly grouping of chemical elements. 

4. a periodic table of chemical elements. 



I 












— -ft/ , ^ _ 
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28 • symbol for the element which has onl-y one proton ar.d 

and one electron is 
(Ap) 1. H (#1) 

2. He #2) 



29 • According to Table 2, v;hich of the following elements 
has the greatest amount of chemical energy? 



30. Group II in Mendeleof’s table. which contains magnesium 
(Mg), calcium (Ca) and strontium (Sr), has spaces for 
other elements. Which one of the missing elements is 
shown in that group in Table 2? 

(Ap) 1. Barium (Ba) 



31. Identify the element with the following characteristics: 
(Ap) A. Its atomic weight is between 133 and 256. 

B. It is a representative element. 

C. It is a non-metal. 

This element is 



32. How many electrons does the element nitrogen (N) have? 
(Ap) 1. 0 



(C) 1. 




2 . 



Ca (#20 
Kr (#36 

SiB 



Radium (Ra 
Cesium (Cs 
Zinc (Zn) 



1. Te 

2. I 
3» jPo 
4. At 




2 . 



5 

7 

14 



1 

1 

I 

] 



1 



j 



The foll^^'ing information must be used in answering 
questions 33 - 35* Four mystery elements with 
atoraic weight and number are given below: 



Element 

'ITo 



Xa 

Xb 

Xc 

Xd 



Atomic Weight 




Atomic Number 

190 

191 
193 

139 



The correct order according to Mendeleef (Tabl.*- - 
(An) 1. , Xa, Xb, Xc, Xd 



The correct order according to Table 2 is 
(An) 1. Xa, Xb, Xc, Xd 

2 . Xc, Xb, Xa, Xd 

3 . Xb, Xa, Xc, Xd 

4. Xd, Xa, Xb, Xc 

Which element would be placed .In the same relative 
position :ln botl tables? 

(An) 1. Xa 

2. Xb 

3 . Xe 

4* Xd 



Why did Mendeleef place elements Cu, Ag, and Au in 
both Groups I and VIII in his table? 

(An) 1. They have characteristics similar to ele 
ments in both groups. 

2. He felt that undiscovered elements simi- 
lar to these would be placed in these 
spaces in Group I. 

3e He thought he had not placed enough ele- 
ments in Group I. 

4. He felt that all elements could be clas- 
sified in seven groups. 



2. Xb, Xa, Xc, Xd 



3 . Xd, Xc, Xb, Xa 

4. Xd, Xa, Xb, Xc 



^ it * 
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37. Acco:/^lng to the reading passage the Zero Group 
(C) 1. cannot he scientifically isolated. 

2o ’ will not ‘•'uh.ite with atoms of otiier elements. 
3. do not fulfill the conditions of the Peri- 
odic Table . 

4 3 Are the only elements in gaseous form. 



38. 



39. 



40. 



42 . 



Very active metals occur in Group I and very active non- 
metals occur in Group VII. A prediction about elements 
in. Group IV v/ould be that they 
(An) 1. have only non-metallic properties. 

2. have only metallic properties « 

3. do not resemble metals or non-metals in their 
properties. 

4. resemble both metals and non-metals in their 
properties. 

If a new element were discovered with an atomic weight 
of 258, which of the following is the best estimate of 
its atomic number? 

(Ap) 1. 102 

2. 106 

107 

Must be larger than 107* 






According to ‘Table 2, calcium (Ca, #20) has chemical 
properties most similar to 
(e) 1. Potassium (K, #19) 

2. Aluminum (Al^ #13) 

Scandium (Sc, #21) 

Zinc (Zn, #30) 






4l. Why did Mendeleef leave gaps in his table? 

(Ap) 1. He believed that forthcoming discoveries 
would need the spaces. 

2. could not find elements with the charac- 
teristics for these spaces. 

3. Atomic weights of known elements could not 
be determined. 

4. He did not know enough about the chemistry 
of known elements. 



According to Table 1, the chemical properties of which 
pair of elements are most simileo:? 

(C) 1. Rb and Hg 

2. Mg and A1 

3. Ni and Cu 

4. Na and K 




Tile symbol {^) stands for atomic number. 



^3. 



^4, 



45. 



46. 



47. 



48. 



49. 



many protons does the element Ac have? 
(Ap) 1. 0 

56 

3. 89 

4. 138 



neutrons to protons in the element carbon 
is* 

,Ap) 1. 1 to 1 

2. 1 to 2 

3 . 4 to 3 

4. 2 to i 



X 

1 



According to Tab3.e 2^ which of the following is a char- 
acteristic of hydrogen (K, #1)? 

(Ap) 1. One outer shell electron drops back. 

2e It is a non-metal. 

3« It is heavier than He. 

4. It is a metal o 

If their existence had been known, which of the follow- 
ing pairs of elements would have been most difficult 
for Mendeleef to place? 

(Ap) 1. Am (#95) and Cm (#96' 

2. Cm (#96) and Bk (#97' 

3. Bk (#97) and Cf (#98^ 

4. Tb (#65) and Bk 

Which pair of elements is most likely to combine? 

(C) 1. Ne (#10) and Ar (#18) 

2. K (#19) and Cl (#17) 

3. Xe (#54) and K (#19) 

4. Rn (#86) and Cs (#55) 

binri.nVrSio^Sf sulphur (S, #l6) com- 

(An) i. 1 to 

2. 1 to i 

2 to 1 

3 to 2 



i: 



of^flourine'^(pf^is^^ oxygen (0) when compared to that 

(C) 1. lower 

the same 
not comparable 
higher 







. r 
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50. According to Mendeleeif in Table i, the number oi' undis- 



covered elements in Group II was 
(C) 1. 1 



2 . 2 




51. Which of the followix^ is most active? 

(C) 1. Fluorine (F) 

2. Chlorine (ci) 

3. Br^Dimlne (Br) 

4. Xciine (I) 

52. Which of the following non-metals is most active? 

• ^ 



53. How many neutrons does the element helium {He) have? 
(Ap) 1. 0 ^ ' 



5^'. The element which has 9 electrons^ 10 neutrons^ and 9 
protons is 



55. According to Table 2,, the chemical elements americium 
(Am, #95) and cuifium (Cm., #96) are 
(C) 1. representative elements. 




Chlorine (Cl, #17) 
:Lodij.^e (i; #52) 
Actinium (Ac, ^9) 








2. inert gases. 




56. An ion which has a charge of -1 
(Ap) 1. has an. extra proton. 



2. is missing an electron, 

3* has mi extra electron. 

4. has an extra proton and electron. 
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57. 



58. 



59 ^ 



NOTE: 




61. 



62. 



An atom with iinequal numbers of protons end neutroms 
is 

(Ap) 1. Hydrogen (H, # 1 ) 

2 - Helizim (He, #2) 

3 . Carbon’ #£I) 

4 , non-existent ’ ‘ ' 

The element Mendeleef called eka-silicoh (eka«Si) is 
now known as 

(C) 1 . gallium (Oa, # 31 ) 

2. germanium (Ge, # 32 ) 

3 » zirconium (Zr, # 40 ) 

4 . Niobium' (Nb, # 4 l) 

An ionic form .of an element has. total of 18 elec- 
trons and a charge' of.. -1» The . element ’ s atomic num- 
ber is 

(An) 1 . 16 

2« 17 

3. 18 

4. 19 .. 

The following information applies to questions 60-6?: 
When a chemist writes the formula for a compound, he 
shows with subscripts the number of atoms of each 
element in a "molecule” of the compound. 



The formula for aluminum oxide (Al, #13 and 0, 
(An) 1 . AI3O2 

2 . AlOo 

3. Alpdo 

4e Ai|d 



#8) is 



Calcium (Ca, # 20 ) and tellurium (Te, # 52 ) cowblne to 
form 

(An) 1. CaTe 

2. CaTep 

3 • CapTe^ 

4. Ca^Teg 

Suppose one was given a compound vdsose formula was 

! 'aO. p.lch group would contain the element indica- 
ted by the question mark? 

(Ap) 1. I 
2. II 

3* III 
4, IV 



******* 



63. 



64. 



66 . 



67. 



68 . 
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If given the atomic number of an element, the atomic 
number of the next element in that group nay always 
be found by 

(An) 1. adding 8 to the Imown atomic number. 

adding 1 if in Group I, 2. if in Group II, 
3 if in Group III, etc. 
multiplying the Icnown atomic number by 2. 
none of the abov(2. 



1 . 

2 . 

I: 



Giveji an e3.ement of the following characteristics: 
(An) A. atomic weight greater than Si. 

B. atomic weight less than V. 

C. general characteristics similar to N. 
This element is 

1 . 



2 . 

i: 



Cv 

P 

Nb 

Ti 



65. After studying his original Table, Mendeleef decided that 



(C) 



1 . 

2 . 

3. 

4. 



iodine should be placed in front of telluriimi. 
iodine had been assigned a false atomic 
weight . 

tellurium had always been in its proper 
position. 

tellurium should be placed in front of 
iodine . 



Since the element names eka-silicon (eka-Si) by Mendeleef 
combines v;ith oxygen, the number of atoms of ska-silicon 
needed to combine with two atoms of oxysen is 
(An) 1. 1 

2 . 2 






O 



Which of the following metals has general characteris- 
tics most similar to those of non-metals? 

(An) 1. Na (#11) 

2. K (^9) 

3. Te #52) 

4. Po #84) 



According to Table 1, an element is missing between Nb 

and Ta in Group V. This element is 

(An) 1. one of the Actinides shown in Table 2, 

2. shown by the unknown element with atomic 
Tiuniber 109 in Table 2. 

3. most likely in Group I in Table 2. 

4. not shown in Group V in Table 2. 



I 

I 

I 

I 

I 

1 

1 

1 

] 

] 

] 

1 

1 

1 

] 

] 

j 



o 
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69 . 



70,. 



71. 



72. 



73 . 



According to Mendeleef , the atomic weight of tellurium 
(Te, #52) should be between 123 and 12?., instead of 
120. Which of the following is the best explanation 
for the placement of Te in Table 2? 

(An) 1. The atomic weight of Te was wrong as 
Mendeleef predicted. 

Table 2 ’is based on atomic number. 

The atomic weight of iodine (I, ^>3) 
proved to be greater than that of^Te. 

The established atomic weight of Te was 
dorfect^ and his .plac2:meffit was incorrect. 

\iHien oxygen combines with an element from Group I, the 
ratio of Group I atoms to oxygen atoms is 
(C) 1. two to three. 

2. two to one. 

one to one. 
three to two. 



2 . 

3 . 



4 . 



I 



(An) 



Which of the following best explains why Mendeleef did 
not leave spaces for the Zero Group elements in his 
table? 

Their physical characteristics differ from 
those of the Typical Elements. 

They cannot be classified as metals or 
non-metals „ 

He cpuld.not predict their atomic weights 
because, they are invisible > 

A table based on atomic weights would not 
indicate omission of an entire group. 

The heaviest non-metal is 
(C) 



1, 

2 . 

3. 

4. 



1. 


I (#53) 


2. 


‘ Te 


(#52 


?• 


Po 


#84 


4. 


At 


(#85 



According to Table 2, 

(C) 1. H (#1) is heaviejr than He (#2). 

^ (ip7) is heavier than Ce (#58). 
(®9) heavier than Pa (#9 
(#84/ is heavier than At (ij®5 



2 . 

3- 

4. 
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7^0 According to Mendeleef *s table there is an element miss- 
ing helOMt Ta in Group Vo Table 2 indicates that this 
eluent 

(An) 1. has not been discovered. 

2. has an atomic weight of approximately 229. 

3. has an atomic niamber of 107. 

4. all of the a'vove. 



75. 




An important use for the periodic table would be to 
(C) 1. develop new methods of classifying elements. 

2. give the total number of elements, 
predict new elements, 
predict prope 2 rties of new elements. 



I 



The atomic weight of water (H^) is 
(Ap) 1. 3 

2 . 10 
3- 18 
4. 20 



77. 



Approximately what per cent of the weight of sodium 
(Na, #11) is neutrons? 




.30 

50 

70 

90 




78 . Suppose an element were discovered which united with 

oxygen two atoms to one. The best estimate of the ele- 
ment’s atomic number is 
(An) 1. 87 

2. 107 

3 . Ill 

4. 267 



79. 



Mendeleef’s basis for placing tel3urium (Te #52) before 
iodine (I, #53) was 

(C) 1. the general characteristics of the two ele- 

ments indicated that their order should be 
reversed. 

2. the discoverer of tellurium was noted for 
bareless work, therefore mendeleef assumed 
him to be in error. 



3 . sould experimentation proved that the weight 
of iodine was wrong. 

4. the atomic numbers of the two elements indi- 
cated that their order should be reversed. 



o 
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80. Which of the following was an. assumption basi c to 
Mendeleef * s work? ^ 

(Ap) 1, All elements coula be classified in 7 groups. 

2 . Miscalcuie,ted atomic weights would show up 
in his table. 

3* Elements can be arranged in an orderly 
sequence based on chemical properties. 

4. Many elements were yet to be discovered^ 
therefore, his table would be incomplete. 

/ 

/ 

/ 
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EBECEDiiiG. PAGE BLANK- NOIfJlMEL) 



ATOMIC STRUCTURE 
(Booklet Number 2) 



Directions 



j* answers \/C each of item®' Ai.gtr shmiif'? >»« 

WTj.tten directly on the test booklet in ti^2 

Of your answer 

Siresh yo® direcbfoL to 

s„?,Mrs s-sls J" 



AS-25 



tiwa>8 i ii i ffim?ni i fi;si M«iTiBw 









I 

\ 



8l. A chemist claims that he was able to make a sample of 
(Sy) xenon, a member of the Zero Group, combine with fluorine. 
Briefly explain what mi^t have happened to produce this 
result. 



82. The article states that Mendeleef started his table by 
(Sy) arranging the elements into seven groups. How migiit his 
results have differed if he had started by arranging 
the elements into seventeen groups? 



83. Mendeleef predicted elements tc fill three of the gaps 
(Sy) in his table, yet he failed to predict elements to fill 
these gaps. 



84 . Write a brief history of the development of the 
(Sy) periodic tables. The article will provide a basis 
for this history, but you should supply events which 
cc Id have occurred in addition to those given. 



85. Srrppose that you were the first chemist to visit 
(Syi another planet. What steps would you take in con- 
structing a periodic table of the elements found on 
that plariet? 



86.-95* Suppose that you have been asked to evaluate the 
author's qualifications to write an article on the 
develoT-’inent of the Periodic Table. Listed belbw are 
several statements which could be true about the 
author. Ass 'Me each statement to be true. Do 
consider any relationships which might exist between 
the statements. 

On the line following the statement place an 
X in the space after: 

” qualified " --if the statement leads you to 
believe tne author is qualified to write about the 
periodic Table. 

"not qualified " — if the statement leads you 
to believe the author is not qualified to write about 
the Periodic Table. 

In the space provided below each statement write 
a brief statement giving the reason(s) why you marked 
the answer you did. 

86. He is a professor of Chemistry at an Ivy League 
(Ev) University. 

qualified not qualified no effect 



87 . He is not a member of the American Chemical Society. 
(Ev) qualified not qualified no effect * 



88. He discovered the element Am. 

(Ev) qualified not qualified no effect 



89 . He recently wrote a higli school chemist3ry book. 
(Ev). qualified not qualified no effect 
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90. He constructed a modem Periodic Table. 

(Ev) qualified not qualified '' no effect 



91* He is a teacher of hi^ school chemistry and does not 
(Ev) use a Periodic Table in his classes. 

qualified not qualified no effect 



92 . He has a college degree in Russian History. 
(Sv) qualified not qualified no effect 



93* He wrote the article for an assignment in a college 
(Ev) English class. 

qualified not qualified no effect 



9^* He was educated in England. 

(Ev) qualified not qualified no effect 



95 . He believes that only about half of the elements have 
(Ev) been discovered. 

qualified not qualified 



no effect 



V 



Raw 

Score 



20 




14 

13 

12 

11 



10 



9 

8 



7 

r 
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2 
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TABLE AS-1 
ATOMIC STRU(?nrRE 
Percentiles* 

Khow].edge 

9 10 11 12 



S'9 

P 

^8 

78 

67 

56 

48 

40 

34 

27 

22 

17 

13 

00 

05 

03 

01 



97 


96 




87 


78 


74 


65 


60 


53 


50 


43 


43 


36 


36 


29 


32 


2^ 


26 


19 


23 


16 


20 


14 


16 


10 


14 


08 


10 


05 


08 


03 


05 


02 


03 


01 


01 



P 

P 

69 

55 

41 



32 

24 

20 

15 

12 



08 

07 

05 

04 



02 

01 



Comprehension 



9 


10 


11 


12 








99 




99 


98 


98 




98 


96 


97 




96 


92 


§3 


99 


93 


88 


0Q 


97 


P 


83 


85 


93 


S3 


77 


76 


88 


75 


70 


68 


80 


65 


61 


58 


71 


55 


52 


is 


60 


43 


44 


36 


48 


34 


35 


26 


34 


23 


26 


19 


22 


14 


16 


11 


11 


07 


09 


06 


04 


03 


05 


02 




01 


02 


01 


01 




01 





computed on the per cent of students scoring 

^ ^'ercentiles for tl*iis form were 

based on the following numbers of students* 



Grade 9 - 1184 
Grade 10 - l4l9 



Grade 11 - 1258 
Grade 12 - II96 



Raw 

Score 

20 

19 

18 

16 



13 

12 

11 

10 

9 

8 

I 



3 

2 

1 

0 



99 

97 

95 

92 

86 

E 

16 

08 

03 

01 
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lABLE AS-2 
ATOMIC STRUCTORS 
Percentiles 



Application 
10 11 12 



IS 

$ 

91 

o5 

79 

70 

59 

50 

38 

27 

18 

09 

03 

ux 



95 

92 



84 

78 

72 

64 

38 

27 

18 

12 

06 

02 

01 



96 



77 

69 

6l 

51 

4o 

29 

21 

12 

06 

03 

01 



9 



99 

97 

94 



69 

57 

42 

16 

07 

02 



Analysis 
10 11 



97 

95 

91 

86 

78 

68 



29 

16 

06 

03 

01 



97 

96 

94 

90 

85 

79 

71 

62 

52 

38 

27 

17 

01 



12 



99 

97 

Q 



9 
90 

85 

73 

70 

60 

m 

35 



07 

04 

01 



I 

I 

I 

I 

I 

I 

I 

I 

I 

I 

I 

I 

I 

I 

I 

I 

1 

1 



I • 



I 1 
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Raw 

Score 

20 

1§ 

17 

16 

11 

13 

12 
11 

10 



1 

3 

2 
1 
0 



TABLE AS«3 
ATOMIC STRUCTURE 
Percentiles 

Synthesis 

9 10 11 12 



Evaluation 
9 10 11 12 




99 

97 

92 

62 

68 

kQ 




23 

8l 

77 

6i 

38 



99 

97 

95 

91 

83 

70 




99 

96 



tr 

74 

64 



49 

30 




i 

I 

I 

I 

{ 



n 

1 : 



f 

i! 

I 



I 



I 

I 

I 



1 

2 



5 

6 



9 

10 

11 
12 



15 

16 

17 

18 

19 

20 







AS-33 
TABLE AS-4 

Item Data 

Atomic Structure 
Knowledge 



Item Di'‘Ii- 

No . Key culty r^^* r^* 



1 

1 

2 

3 
2 

2 

4 

? 



2 



4 

2 

3 

1 

1 



.88 

.81 

>74 

.56 

.84 

.67 

o77 



.43 

.43 

.46 

•54 

•36 

.58 
.56 
.54 
59 
to 






1 

2 



.78 

.73 

I 

.87 

.87 

.63 

.6o 

.62 



.56 

.59 

.oO 

.60 

»62 



Baw Score 

Mean » 14*05 
S.D. » 4.25 
KR #20 « 0.836 



Proportion Choosing 
Each Response 

1234 



Omit 





.88 


.04 


07 


.01 


.00 




.51 


.19 




.19 


.02 


46 

54 


.11 


.81 


.06 


.02 


.00 


.08 


.12 


.74 


.06 


.01 


36 


.19 


.56 


.10 


.15 


.01 


58 


.06 


.8‘i 


.05 


.04 


.00 




.05 


.1^. 


,11 


.67 


.00 


54 


.05 




.77 


.06 


.00 


59 


,10 


.Cj> 


.11 


.73 


.00 


40 


.23 


.58 


.11 


.07 


.01 


56 


.08 


.05 


.08 


.78 


. 01 


59 


.09 


.73 


.12 


.05 


.01 


60 




.Ob 


.77 


.10 


.00 




•§5 


.05 


.03 


.03 


.01 


62 


.87 


.04 


.05 


.03 


.01 


27 


•27 


.13 


.53 


.25 


.02 


E 


.o4 


.05 


.87 


.03 


.01 


49 

46 


.05 


.09 




.63 


.03 


.60 


.12 


.16 


.11 


.01 


44 


.14 


.62 


.17 


.05 


.01 



Corrected Score 

Mean = 12.11 
S.D.> = 5.64 

KR #20 = 0.929 



N w 5105 



* l^Z 



Point biserial correlation, raw scores 
Point biserial correlation, corrected scores 
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T&BLg AS-5 

Item Data 

Atomic Structure 
Ccn^rehenslon 



Proportion Choosing 



Item 

No. 


Key 


Diffi- 

culty 


r ♦ 
1 


r ♦ 

2 


Each Response 

123 


4 


21 


1 


.52 


.35 


.40 


.52 


.11 


.08 


.27 


22 


3 


.53 




•42 


.11 


.10 


.53 


.24 


25 


? 


.62 


.43 


.48 


.12 


.17 


.62 


.08 


27 


4 




.30 


.34 


.16 


.15 


.16 


.52 


29 


4 


.67 


.37 




.11 


.10 


.11 


.67 


37 


2 


.67 


.47 


.50 


.08 


.67 


.09 


.13 


40 


4 




.06 


.04 


•53 


.13 


•15 


.09 


42 


3 


.18 


.03 


eOO 


.08 


.21 


.18 


.47 


47 


2 


.46 


.42 


.40 


.18 


=46 


.15 


.13 


49 


1 


.59 


.56 


.55 


.59 


.10 


.11 


.12 


50 


3' 


-56 




.52 


.10 


.14 


.56 


.11 


51 


1 




.42 


.40 


.35 


.16 


.15 


.24 


5; 


4 


.42 


.50 


.48 


.12 


.14 


.20 


.42 


58 


2 


•39 


.50 


•46 


•13 


•39 


.23 


.10 


63 


3 


.14 


.03f 


0 

0 

• 


.18 


.18 


.14 


.28 


70 


2 


.33 


.49 




.13 


.33 


.18 


.09 


72 


4 


•35 


«.49 


.41 


.11 


.13 


0I3 


.35 


73 


3 


.32 


.44 


.36 


.12 


.15 


.32 


.11 


75 


4 


.24 


.39 


.32 


.14 


.15 


.16 


.24 


79 


1 


.20 


.31 


.24 


.20 


.14 


.18 


.16 



Raw Score 


Corrected Score 


Mean * 8.13 


Mean » 5.00 


S«D. * 3.52 


S.D. * 4.38 


KR #20 » 0.693 


KR #20 = 0.821 



N « 5105 

*r. * Point hiserlal correlation;^ raw scores 

a Point biserlal correlation^ corrected scores 



AS -35 
AS-6 

Item Data 

Atomic Stanicture 
Application 



Item 

No. 





Diffio 
Key culty 



Proportion Choosing 
Each Response 

rg* 1 2 3 4 Omit 



1 

1 




.pe 

.42 




2 


.31 


•3? 


•33 


4 


.51 


.44 


.49 


3 


.53 


.39 


.41 


1 


.45 


.45 


.47 


1 


.40 


.28 


.27 


3 


.63 


M 


.47 


1 


.35 


.49 


.49 


4 


.31 


.36 


.36 


3 


.31 


.27 


.24 


2 


.22 


.16 


.12 


2 


•50 


.48 


.43 


2 


.38 


.49 


.46 


3 


.36 


.50 


.47 


1 


.25 


.36 


•32 


1 


. 33 


.47 


.43 


3 


.28 


.36 


.30 


2 


.25 


•3i 


.25 


3 


.22 


. 26 


.20 



*53 


.16 


.18 


.12 


.01 


,67 • 


.18 


.08 


• O6 


.02 


.30 


• 3 J 


.18 


.19 


.02 


,14 


.16 


.17 


.51 


.02 


,11 


.11 


.53 


.22 


.02 


45 


•?5 


.09 


.28 


.04 


40 


.41 


.10 


.05 


.04 


09 


.14 


.63 


.08 


.06 


35 


.26 


.14 


.19 


•O6 


13 


.34 


.16 


.31 


.06 


12 


.18 


.31 


.30 


.08 


25 


.22 


.15 


.27 


.11 


15 


.50 


.11 


.14 


.11 


10 


.38 


.30 


.11 


.11 


12 


.29 


.36 


.11 


.12 


25 


.14 


.17 


.30 


.14 


33 


.21 




.11 


.19 


15 


.17 


.28 


.08 


.31 


22 


.25 


.13 


.08 


.32 


19 


.12 


• 22 


.15 


.32 



Raw Score 

Mean « 7.79 
S.D. = 3.6o 
KR #20 = 0.694 



Corrected Score 

Mean = 4.42 
S.D. = 4.53 
KR #20 = 0.826 



N s 5105 



= Point biserial correlation, raw scores 
~ Point biserial correlation, coirrected scores 



2 ABLE AS -7 

Item Data 

Atomic Structure 
Analysis 



Item Dlffl- 



Ho. 


Key 


culty 




^2 


M 


1 


.33 


.25 


.27 


33 


3 

2 


!42 


.31 

•39 




34 


4 


.38 


.43 


.48 


35 


1 


.38 


.37 


.40 




1 


.57 


.32 


.37 


?§ 


4 


.50 


.39 


•45 


48 


2 


.23 


.30 


.28 


59 


2 


.39 


.42 


•35 


60 


3 


.25 


.39 




61 


1 


.23 


.33 


.27 




4 


.38 


.50 


.42 


64 


2 


.37 


.54 


.44 


66 


1 


.16 


.24 


.16 


67 


4 


.19 


.30 


»22 


68 


4 


.23 


.41 


.32 


69 


2 


.23 


.35 


.25 


71 


4 


el 2 


.19 


.11 


74 


1 


.26 


.39 


.29 


78 


3 


.18 


.19 


.09 



Proportion Choosing 
Each Response 
1234 Omit 



33 


0O9 




.40 


.01 


11 


.22 


.56 


.10 


.01 


20 


.42 


.16 


•19 


• 03 


18 


.17 


.23 


.38 


.04 


38 


.20 


.22 


.16 


.04 


57 


.22 


• 

0 

00 


.10 


•03 


12 


.14 


.20 


.50 


.04 


23 


.23 


.22 


.23 


.09 


08 


. 39 


.21 


.15 


.16 


26 


.18 


.25 


.13 


.17 


23 


.22 


.24 


• 13 


.18 


12 


.17 


.13 


.38 


.20 


11 


.37 


.17 




.21 


16 


.27 


.20 


.14 


• 23 


16 


.16 


.25 


.19 


.24 


17 


.17 


.16 


.23 


.26 


19 


.23 


.20 


.11 


.27 


17 


.19 


.24 


.12 


.28 


25 


.14 


.14 


.15 


.31 


20 


.20 


.18 


.10 


.32 



Haw Scores 



Corrected Score 



Mean » 
S«D» a 
KR #S !0 a 



6.35 

3.17 

0.632 



Mean 2.8^ 

S.O. 3.80 

KB #20 = 0.760 



H = 5105 

•Tj^ = Point biserlal cowrelation, raw scores 
rg Point blsesrlal correlation, correc';ed scores 
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ability to apply skills and 
und&rs bandings which you t>%vs been learning since you 

entered school. You will be asked to read a passage called 
Glaciers ana then you will be asked to answer questions 
the'^t St* refer to the passage at any time during 



X marked on the answer sheet which 

Tf provided for you. Use only the special pencil 

that has been provided. Do not ma^e any stray marks. If 

new error, erase it completely before' marking your 

new answer. 

Make no marks in the test booklet . 

irroiY. following is a sample question to show you how 

your answers are to be marked. Study the sample and if you 
have any questions raise your hand. 



SAMPLE 



ON b.^^ARATP. ATff giisST 



1 . 



The article you will read is 
about 

1. glaciers. i, 

2. chemistry. 

3» glass-blowing. 

4. the Spanish-American War. 



1 18 ^ 2 3 “ 



nrt+ Should answer as many questions as you can. Do 

not Mpend S' great amount of time on any one question. If 

answer to a question^ then guess, 

R.P. Kropp and H.N. Stoker^ Editors 
Department of Educational Research and Test Inc 
and Institute of Hum&n Learning 
Florida State University 
Tallahassee 

April, 1965 



Experlmenta;!. edition j to be used for research purposes. 

C--1 
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This eu^erimeRtal test was constructed as part of a 
research project supported by the U. S. Office of Education 
under Contract Number OE-4-10-019^ Project Number 2117. 



The copyright holder of the material which appears 
in the reading passage of the test kindly permitted the 
project staff to use the material experimentally and the 
hoxaer subsequently extended this permission to all persons 
who wish to use the experimental version of the test for 
research purposes. 



GLACIERS 



Ice plays a critical role in the water economy of the 
earth. About 86 per cent of it is in the Antarctic, 
where it exerts a profound influence on the weather 
in all parts of the world. 

By William 0. Field 

Water is one of the few substances on earth exist- 
ins in nature in all three physical states— liquid, solid, 
and gaseous. Altogether our planet cont.'^ins some 350 million 
cubic miles of water, most of it, of course, in the oceans. 

Of the earth's total water budget, not much more than one per 
cent is in the solid form of ice or snow, and far less than 
that in the form of water vapor in the atmosphere. Yet these 
piroportions make up a delicate balance which is immensely 
important to life on the earth. Any appreciable change in 
the ratios of water, ice and atmospheric moisture would have 
catastrophic consequences for man and his economy. The ice 
piled in glaciers on the lands, for instance, exercises a 
vital control over sea levels, climate and the continents' 
water supplies. 

Glaciers now cover about ten per cent (nearJJy six 
million square miles) of the world's land area. Our estimate 
of the total amount of water in them is only a rough guess, 
mainly because we have only a hazy notion of the thickness of 
the Antarctic ice sheet. This vast icecap accounts for about 
86 per cent of the world's glacial area. The Greenland ice- 
cap makes up another ten per cent. The remaining four per 
cent is not minor, as far as its effects go, for it includes 
tens of thousands of square miles of glaciers on mountains 
in the temperate zones, where they intimately influence man's 
climate and water supplies. 

Estimates of the total volume of water in the 
world's glaciers range from about 2.4 million to more than 
six million cubic miles. If all this ice melted, the level 
of the world's oceans would rise by something like 65 to 
200 feeti 

Glaciers can grow only in areas where the snowfall is great 
enough, year after year to exceed the annual rate of meltings 
Consequently, the ice sheet is not necessarily thickest where 
the climate is coldest. In Alaska the greatest concentration 
of glaciers is along the southern coast, which is the warmest 
part of the Territory but has the heaviest winter snowfall. 
Parts of northern Greenland are barren of glaciers because 
there is not enough snowfall. 
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As snow accumulates, the pressure of the mountain- 
ous layers compacts it into ice. Under its own weight ice 
begins to flow to lower elevations. The rate of flov of 
glaciers varies tremendously: seme move very slowly v^hile 

others slide as much as 50 feet per day during the summer. 

At th6 lowsr 6l6vations^ th6 glacisr oi6lts or dischargss ic^*^ 
bergs into the sea. But under suitable conditions, the 
glacier front may advance over the land year after year. It 
takes only a slight change in the combination of annual 'snow- 
fall, melting-season temperatures and other meterological 
conditions to produce an advance or retreat of a glacier. 

Probably during most of the earth’s history it has 
been free of glaciers* We are in an exceptional era--neither 
glacial nor nonglacial. During the last million years there 
nave been at least four great ice ages; at the3.r maximum, ice 
covered about 32 per cent of the world’s land surface. The 
ice ages were separated by long warm intervals during which 
the glaciers nearly disappeared. At present we seem to be in 
an in-between stage, somewhere between a glacial and an inter- 
glacial age. Some glaciers are growing: others are dis- 
appearing. 



During the last Ice Age the sea level probably 
was more than 300 feet lower than now. Over the world the 
t^peratures averaged 7 to l4 degrees colder. There were five 
continei^al ice sheets cf mo>e than one million square miles 
each. Three of these, in North America, Europe and Siberia 
have disappeared, but the two jn Greenland and Antarctica 
remain. Mountain glaciers he.ve all shrunk. 



• t_ civilizations began to arise in Western Asia 

and Norvih Africa just as the European and North American 
sheets were disappearing. About 3000 B.C. the climate in many, 
parts of the world was drier and warmer by two or 
three^degrees than at present. The sea level was apparently 

Slacial region in the Alps was 
least 1,000 feet higher than today.- Ice in the Artie 
Ocean ppbably melted completely each summer. Parts of the 
t^perature regions where small mo^intain glaciers now furnish 
the summer water supply must have been arid. 

n n mu conditions began to change drastically about 1000 
climate became colder and more stormy in many parts 
of the ^d by about 500 B.C. glaciers began to grow 

again. Then, in the first millennium of the Christian era, 
c^e a period of fj.',acier recession. After that glaciers 
^y^ced again t. a maximum in the 17th to 19th centuries. 

8 resurgenC'v of glaciers x*jas noted directly by observers 
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in the Alps, Scandinavia and Iceland. Since the latter 
half of the 19th century, glaciers throughout the world have 
tended to shrink once again. As a result the sea level has 
apparently been rising recently at the rate of approximately 
2.5 inches per cent^iry. Some glaciers, however, have 
advanced, contrary to the general trend. In parts of the 
western U.S. there is a growth of glaciers at present which 
may indicate a changing climate. 

Glaciers have been studied seriously for a little more 
than 100 years. Beginning in I919 Hans Wison Ahlmann of the 
University of Stockholm (now Sweden *s Ambassador to Norway) 
introduced a new era in glaciology. He took a new look, 
in greater detail, at glaciers in Scandinavia, Iceland, 
Spitsbergen and northeast Greenland, and his examination 
led to new methods of measuring their nourishment and 
wastage. Observations of glaciers are now being made on a 
systematic basis in several parts of the world. Ittiring the 
last decade, important studies have been carried out in 
Greenland, especie,lly by Paul Victor’s French Polar 
Expeditions, wMch determined the volume of the Greenland 
ice sheet arid studied its regimen over a broad area. 

The little-known Antarctic ice sheet is more than one 
and a third times the size of the U.S. and its territories. 
It covers practically the whole continent of Antartica. 

Fully three million square miles of the continent have never 
been seen even from the air. The continent’s i-^ecap is 
hnown to rise as high as 10,000 feet, but the thickness of 
the ice has been measured in only a few places. 
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Table 1. Distribution of Water Volume 



LOCATION 


CUBIC MILES 


Water in the oceans (close estimate) 


329,000,000 


Water in the atmosphere (rough estimate) 
Water in glaciers (average of high and 


3,600 


low estimates) 


4,200,000 


Water in lakes and rivers (rough estimate) 


55,000 


Ground water above 12,500 feet (very 


i; 080,000 


rough estimate) ‘ 


Ground water below 12,500 feet (very 




rough estimate) 


19, ’00,000 


Table 2. Distribution of Ice by Area 


lOCATION 


SQUABE MILES 


Africa 


8 


Antarctica 


5,019,000 


Asia 


42,200 


Canadian Arctic Islands 


45,000 


Europe 


5 ; 370 


Greenland 


666,300 


North America 


30,890 


Northern Atlantic and European Arctic Islands 45,400 


Pacific Islands 


393 


South America 


9,650 


Sub-Antarctica Islands 


1,160 


World Total 


5,864,370 
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AVALAKCHE 




Figure 1. 



LOT OF A GLACIER is depicted in this cross section of an ideal 
y^ley glacier. Palling snow carried by avalanche is con^ressed 
3xe, ^ch begin to move by its own weight. The line 
^vidi^ the areas of accumulation and loss is the fim line 
^cumulation equals total melting. Variations in 
snowfall, ten5)erature and other conditions determine idiether 
the glacier sidvances. 



Adapted from 

Williaiu 0. Field, "Glaciers," Scien tific American, Sentember. 1Q5S. 
pp. 84-92. “ 
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Figure 3. /^proximate Height of Snow Line at Various Latitudes 
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1 . 



2 . 



3 . 



4. 



5 . 






7 . 



8 . 



The glaciers in the Antartic iiifluence the weather 
(K) 1. only in the southern hemisphere • 

2. only in the northern hewi sphere. 

primarily in the noi'thern hemisphere, 
in all parts of the world. 



I: 



Which of the following is one of the natural physical 
states of matter? 

(K) 1. ice 

2. frozen 
solid 
hard 



I 



In which physical state is most of the earth's water? 
(K) 1. liquid 

2. frozen 






gaseous 

ice 



What per cent of the earth's water budget exists as 
water vapor? 

(K) 1. less than 1 

2 . 4 

3 . 10 

4 . 86 



The ice in glaciers does not control 
(K) 1. sea level 

2. climate 
wind speed 
water supply 



I: 



Glaciers now cover 

(K) 1. about 10 per cent of the world's land areao 

2. about 10 per cent of the world's surface area, 
about 60 million square miles, 
only the polar regions. 



1 : 



The world's second largest glacial area is in 
(K) 1. Antarctica 

Canada 
Greenland 
Siberia 



I 



The thickness of glaciers is primarily determined by the 
(K) 1. land surface. 

altitude of the glacier, 
average temperature of the area, 
tzflount of snowfall. 
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10 . 



11 . 



12 . 



13. 



14. 



15. 
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There are fewer glaciers in nor them Alaska than in 
southern Alaska because northern Alaska has 
(K) 1. colder weather. 

2. less snowfall,. 

3. more snowfall 

4. fewer valleys in which glaciers could fom. 



Icebergs are .formed by 
(K) 1. the freezing of sea water. 

2. glaciers advancing into the oceans, 
glaciers forming over the oceans, 
snow falling into the oceans. 



f 

I 



How many ice ages have occurred during the last 
million years? 

(K) 1. 1 

2 . 2 

I I 



Approximately what per cent of the world’s land surface 
was covered with ice during the great ice ages? 

(K) 1. 10 

2 . 20 

3. 30 

4. 40 






We now live in a period which is neither glacial nor 
nonglacial. Which of the following is the best evi- 
dence of this fact? 

(K) 1. Extremely large glaciers are melting. 

The climate is constantly changing. 

The annual snowfall is decreasing. 

Some glaciers are growing and others are 
shrinking. 



2 . 



Of the five continental ice sheets formed during the 

remain. One of them is located in 

(K) 1. Canada 

2. Greenland 
Norway 
Siberia 



I 



As compared with our present climate, the climate of 
the world in 3000 B.C. was 
(K) 3 ,. drier and colder. 

drier and warmer, 
damper and colder, 
damper and warmer. 
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l6. Hans Ahlmann did not study the glaciers in 
(K) 1. Antarc^ca 

2. Greenland 
3* Iceland 
4. Scandinavia 



17 . 



Where 

(K) 



is most of the world ®s water? 

1. in the oceans 

2. in the atmosphere 

3. below the ground 

4. in glaciers 



l8. According to Table 2, glaciers can be found in 
(K) 1. Africa 

2. Europe 

3. South America 

4. all of these places 



19* The line dividing the areas of accumulation and loss 
is called the 
(K) 1. fim line 

• 2. dew line * 

3. glacier line 

4. loss-runoff line 



20. According to Figuire 2, what was the maximum volume of 
water and when did it occur? 

(K) 1. 263 million cubic miles > i million years 

2. 345 million cubic miles, ij million years 
ago. 

3. 339 million cubic miles, 2 million years 
ago. 

4. 270 million cubic miles, 1 million years 

€tgo. 



21. If glaciers cover about ten per cent of the land area, 
or about six million square miles of "the earth, then 
the land area of the earth, in square miles, is appro- 
ximately 

(C) 1. 5 i 4 oo,ooo 

2. 6,000,000 

3. 54,000,000 

4 . 60,000,000 
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22. The great continental ice sheets disappeared from the 
United States and Europe about 
(C) 1. 3jjOOO years ago 

2. 15j.000 yea^s ago 

3 * 250,0C'D years ago 

4. 500,000 years ago 



23. 




25. 



26. 



If the average temperature in the Great Lakes region 
dropped until the lakes were never completeljr free of 
ice. which of the following would most likely result? 
(An) 1. Valley glaciers would form in the lake beds. 

2. The amount of water 3 ji the oceans would 
Increase. 

3. The amount of snow in the southern United 
States would increase 

4. The Artie ice sheet would recede. 



^at might happen if the earth's glaciers were to melt 
during the next decade? 

(Ap) 1, Greenland would develop into an important 
nation. 

2. The great seaports of the world would dis- 
appear under water. 

3. Antarctica would emerge as a large contin- 
ental mass. 

4. Australia would submerge. 



TOie term "RUNOFF” which appears in Figure 1 

(Cl 1. is defined clearly in the reading passage. 

2. is not essential for understanding glaciers. 

3. restates the central idea of glacier 
formation. 

4. is a synonym for "melt." 



If one wlshea to estimate from the information in the 
passage the amount of water in the Antarctic ice sheet, 
/A ? assumption would have to be made? 

(An) 1. The average thickness of the Antarctic ice 
sheet is equal to the avert ^e thickness of 
all the world's glaciers. 

2. The averse temperature of Antarctica is 
about thfe same 'as the average teiSperhture 
of other glacial areas. 

3. Snowfall in Antarctica is about equal to 
the snowfall in other areas. 

4. The ratio of growth of the Antarctic ice 
sheet is about the same as that of other 
glaciers. 
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27* i'act that the great Alaskan glaciers are located 

ill forested areas implies that these glaciers a^-e 
(C) ' i. part of a vast ice cap. 

- ' 2.- the world *s thickest glaciers. • 

3. ’r&nainihg ‘port ions of a receding ice cap. 

4 . temperate i zone glaciers . 

< • ’ 

28. What is the relationship between 

(Ap) A, Altitude of snow line, and 
B. Average rainfall. 

1. An -Increase in A is accompanied by an 
increase in B. 

.2. An increase in A is accompanied by a 
decrease in B. . * 

3. A and B are unrelated. 

4. The relationship catnnot be determined 

■ • ' • ■■ •' from the passage.- 



29i During the las1> 'ice- age, the highest sunimer temperatures 
in what is now the southeastern United States was 
approximately 
(C) 1. 70 degrees 

2. 85 degreies 

3. 110 degrees 

4. 120 degrees 

30. What is the relationship between 

(Ap) A. Distance from the Poles, and 
B. Average wind velocity. 

1. An increase in A is accompanied by an 
increase in B. 

2. An increase in A is accompanied by a 
decrease in B. 

3. A and B are unrelated. 

4. The relationship cannot be determined 
from the passage. 

31. Reread the third, para'^aph of the article. New assume 
that 5 million cubic miles of water are contained in the 
world *s glaciers. If the glaciers melted completely, 
approximately how many feet would ocear': levels rise. 

(Ap) 1. 70 

a. 100 

3. 160 

4. 190 
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If the glacier shown in Figure i is located at lati- 
tude 68 degrees N, according to the infomation given 
in Figure 3> "RUNOFF” would begin at approximately 
(Ap) 1. 4^500 feet 

2. 9^000 feet 

10,500 feet 
13>500 feet 



I: 



33- 



34 . 



35. 



36. 



Which of the following best describes the entire 
article? 

(An) 1 , It presents evidence that we are in an 
interglacial period. 

2 . It describes in scientific language the 
growth and decline of glaciers. 

3. It presents arguments to show the need for 
increased study of glaciers. 

4 It shows the critical role ice plays in the 
economy of the earth. 

Suppose that one inch of snow per year fell in a barren 
land, and tha.t the temperature never exceeded the free- 
zing point, and that no glaciers ever formed. One pos- 
sible explanation for the absence of glaciers is 
(An) 1. the absence of avalanches. 

2. that the snow evaporates. 

3» that runoff is greater than snowfall. 

4. that the snow is immediately converted to 
ice. 

The least important factor in glacier formation is 
(An) 17 ~ annual snowfall. 

2. low temperature. 

3* atmospheric pressure. 

4. distance from the equator. 

If you saw a piece of ice, weighing about IOC pounds, 
floating in the Gulf of Mexico, which of the following 
would be the most reasonable explanation for its 
presence? 

(An.) 1. It was arcifically formed and had just been 

dropped from a passing boat. 

2. It' was ' ah iceberg' v/hieh-'^was^ formed off the 
coast of Greenland and drifted to the Gulf. 

3. It was formed in the Rocky Mountains and was 
carried to the Gulf. 

4. It was the result of hail massing as it fell 
into the Gulf. 
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38. 



39. 



40. 



The size and number of glaciers have remained relative- 
ly unchanged during the past two thousand. years; however, 
(C) 1. there have been substantial changes from 

century to ’century. .during the period. 

2. sea level has Increased by 2| Inches each cen- 
tixry for the last five centuries. 

3. glaciers in the United States have disappeared 
but those in Europe have increased in number 
and size. 

4. the volinne of water in the atmosphere has 
increased substantially. 

Temperate .zone glaciers play an in 5 )c»rtant role in the study 
of cii^?.. Oology because 

(An) 1. they are easily accessible for observation and 
study. 

2. there are plentiful records of weather condi- 
tions and glacial growth r*or this zone. 

3* the physical characteristics of temperate zone 
glaciers are different from those of glaciers 
of other zones. 

4. the temperate zone glaciers are more likely to 
advance or retreat. 

The process of converting snow to ice in the formation of a 
glacier is similar to the process of m^ing 
(Ap) 1. steam from water. 

2. wool by sheep. 

rayon from chemicals, 
coal from vegetation. 



I 



According to Figure 2, the smallest amount of water in 
solid form existed how many million years ago? 

(C) 1. i 

2 . 1 

3. li 

4. 2 



4l. What is the relationship between 

(Ap) A. Amount of glaciation in the world, and 
B. Surface area of land. 

1. An increase in A is accompanied by an 
increase in B. 

2. An increase In A is accompanied by a 
decrease in B. 

3. A and B are mirelated. 

4. The relationship cannot be detienriined from 
the passage. 
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If all of the ice in Antarctica were melted bv arti- 
flcial means and all other ice areaa remained the same 
then the maxtoim^rise in the world'.? oceans would 

170 feet 
240 feet 
210 feet 



I 
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^^o™atlon applies to questions 43-/+S. 
gra^io^aref?^^"" ® conditions of a geo- 

*'^8h temperature in 70 degrees 
F. in the summer months, 

C. average annual melt is 10.000 cubic feet 
per square mile. 

Do these conditions have existed for 100 years. 



43. 



44 . 



45. 



fhis region probably 
(Ap) 1. has no glaciers. 

2. is highly glaciated. 

3 . is near a glaciated area. 

4. has a few small glaciers. 

annual melt were to be reduced to 9,500 cubic 



(Ap) 1. 

a. 

I 



wvf*xv*JLUJLWXXO CXlcinSP X 

would decrease to less 
ou?.iic feet per square mile, 
^aciers would heg:ln to form, 
ae amual snowfall would increase. 

6 woulci bsgin to dXs€ipp6&z^o 



?An? would cause a decrease in the annual melt? 
o' J"ci*ease in «tnnual snowfall. 

Dp^r« 4 =f average daily summer temperature. 

5" average atmospheric pressure 

4. Increase in average daily winter temperature. 
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he. 



hi. 



hS. 
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50. 



51 . 



What is the relationship between 

(Ap) A. Glaciation of North America, and 

B. Prevailing temperature in southeast United 
States, 

1. An increase in A is accompanied by an 
increase in 3. 

2, An increase in A is accompanied by a 
decrease in B. 

3. A and B are unrelated. 

4, The relationship cannot be determined 
from the passage. 

The purpose of Figure 1 is to 

(C) 1. preaent a picture of glacial formation. 

2. show areas of a glacier where snowfall and 
evaporation occur. 

3. introduce the concept of runoff. 

4. show one of the results of an avalanche. 



Reread the third paragraph of the passage. Which of 
the following facts must be Imown to justify the con- 
clusion? 

(An) 1. The average world temperature. 

2. The volume of water in the oceans. 

3. The volume of ice in glaciers. 

4. The average snowfall per year. 



According 
cribe the 
(C) 1. 



2 . 



3 . 

h. 



to Figure 2, which of the following best des- 
world If million years ago. 

It was almost completely covered with 
glaciers. 

There were deep valley glaciers in high 
mountainous regions. 

There were probably no glaciers at all,. 
Continental ice sheets were growinig. 



^e Antarctic ice sheet is approximately the sise of 
(C) 1. Europe and Asia. 

2. the Iftiited States and fessia. 

3. the United States and Mexico. 

4. the Arctic ice sheet. 



Which of 
the past 
(C) 1. 

2 . 

3. 

h. 



best describes conditions during 
2,000 years? ^ 

Glaciation has fluctuated. 

Sea level has been constantly decreasing. 
America’s continental glaciers have disap- 
peared, but Europe’s have not. 

Water in the atmosphere has decreased. 
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******* 

NOTE : The following information must he used in axiswering 

questions 52-55 : 

The earth has existec', many millions of years 
during which its ocean content was not always 330 
million cubic miles. Prom the preceding statement 
and what you know of earth history, answer questions 
52-55 according to the following key: 

KEY : 1. Water content exceeded 330 million cubic 

miles. 

2. Water content was less than 330 million 
cubic miles. 

3. Water content remained 33O million cubic 
miles. 

4. No evidence exists for a valid conclusion. 



52. 



53. 



54. 



During the time of the last ice sheet in North America. 
(AP) 

During the time when most of the Caribbean Islands 
were larger than they are now. 

(Ap) 

When the volume of water in the Great Lakes was at 
its maximum. 

(Ap) 



******* 



55* A glacier can best be described as a 



56. 



A g. 

(Cj 



1 . 

2 . 

1 : 



snow field, 
moving ice field, 
product of low temperature, 
valley packed with ice. 



What is the relationship between 
(Ap) A. Average world temperature, and 
B. Amount of water :ln the oceans. 

1. An Increase in A is accompanied by 
an increase in B. 

2. An increase in A is accompanied by 
a decrease: jji B. 

3» A and B are unrelated. 

4. The relationship cannot be determined 
from the passage. 
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57 . 



58. 



Wha.t is the relationship between 
(AP) A. Amount of snowfall, and 
B. Amount of glaciation. 

1. An increase in A is accompanied by an 
iTicrease in B. 

An increase in A is accompanied by a 
decrease in B. 

A and B are unrelated. 

The relationship cannot be determined 
from the passage. 



2 . 



?• 

4. 



Approximately 96 per cent of the glacial area of the 
world is located 

(C) 1. in the southern hemisphere. 

2. outside the temperate zone. 

3. in the eastern hemisphere.' 

4. in Antarctica. 



59. 



60. 



61. 



One plausible reason for the lack of g3aciers in Africa 
is that 

(An) 1. it has no high mountains. 

2. the southern hemisphere is less glaciated 
than the northern hemisphere. 

3. large areas of desert prevent glaciers 
from forming. 

4. the average aruiual range of temperature is 
too small. 

An increase of 10 per cent in the average world temper- 
ature would have which of the following effects? 

(An) 1. Increase the water in the atmosphere. 

2. Cause over 4,500,000 cubic miles of water to 
freeze into glaciers. 

3» Lessen the 300 million cubic miles of water 
in the oceans. 

4. Decrease average annual rain fall. 

Water at the northern end of the Greenland ice sheet 
would most probably exist naturally in 
(An) 1. solid form only. 

2. solid and liquid foims only. 

3* solid and gaseous forms only. 

4. solid, liquid and gaseous forms. 
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62. What is the relationship between 

(Ap) A. Number of glaciers near the coast, and 
B. Number of icebergs in the ocean. 

1. . An increase in A is acconqoanied by an 
• increase in B. 

2. An increase In A is accompanied by a 
decrease in B. 

3* A and B are unrelated. 

5. The relationship cannot be determined 
from the passage. 



63. Assume that the average temperature in the United 

States will drop 50 degrees P. tomorrow, and remain 
the same for 500 years. Where would you expect to 
see the first new valley glaciers? 

(An) 1. Kansas -Nebraska wheat belt. 

2. Texas-Oklahoma cattle country. 

p. Northern Alaska. 

4. Central eastern seaboard. 



64. If all glaciers melted, which one of the following 
predictions would be false? 

(An) 1. Coastal resorts would be flooded. 

2. The climate would be warmer. ' 

3. The salt content of the ocea’^.s would be 
increased. 

4. Mass migration of people would take place. 



65. 



The total volume of water in the world’s glaciers is 
approximately 

(c) 1. one million cubic miles. 

2. two million cubic rabies. 

3. four million cubic miles. 

4. seven million cubic miles. 



66. Suppose the Anarctica ice sheet were melted. What 

would be the new elevation of a city which is now I60 
feet above sea level? 

(An) 1. 180. feet below sea level 

2. 50 feet below sea level 

3. 25 feet above sea level 

4. 50 feet above sea level 



67. The life of a glacier is depicted in Figure 1. None 
of the ice mass would occur in the areas marked 
(An) 1. avalanche and runoff. 

2. accumulation and avalanche. 

3. accumulation and runoff. 

4. loss and runoff. 
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68 . 



69. 



70. 



71. 



72. 



1 . 

2 . 

i: 



1 shows the distribution of water on the earth. 

of the following sources of water is not accoun- 
ted for in this table? 

(An) 1 . Water “trapped” in coal and oil deposits, 
water contained in living plants and 
animals . 

Water contained in clouds. 

Water contained in preci itation. 

Figure 2 xndicates that the change in volume of water 
has been constant during the past two hundred thousand 
years. However, this figure see^ms to conflict witHhe 
concerning glacier activity during the past 
ohree thousand years. Wh 3 .t might account for this 
disagreement? 

(An) 1 . The author, W. 0 . Field, is probably wrong 
^ his description of glacier activity. 

^e graph (Figure 2 ) is probably wrong. 

The changes in water volume were not affec- 

S^COO^years^^^^^^^ during the past 

^ water volume during the 
past 3,000 years were insignificantly small 
in comparison with the long range trend. 

^e serious study of glaciers began about the time of 

(C) 1 . Civil War. 

Golden Age of Greece. 

French Revolution, 
discovery of America. 



2 . 

3. 

4. 



1 . 

2 . 

3. 

4. 



(An) . 1 . this region is less than 

13j500 feet. 

2 . temperature reaches 80 degrees P. in 
the summer months. 

3. The temperature reaches 30 degrees P. belo 

Z6Z*0« 

4. It is too far from the polar ice cap. 

Glaciers stopped advancing over North America when 

' * mild climate south of the 

Tropic of Cancer. 

2 . accumulation exceeded loss. 

4. the edges reached the sea and formed 
icebergs . 



o 

ERIC 
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73. According to Figure 2 , how did world conditions one 
million years ago compare to those of 1^ million 
years ago? 

(C) 1. Similar, cold and diy. 

.2. Similar, warm and humid. 

; . 3. Dissimilar, almost opposite. 

5. Not enough information is given to make 
comparison. 



74. Suppose that a scientist calculated that if a certain 
proportion of the glaciers melted, then a city now 
500 feet above sea level would be only 250 feet above 
sea level. He probably assumed which one of the fol- 
lowing in making his calculations? 

(An) 1. The volume of a kilogram of wsitef varies 
directly with temperature. 

2. One cubic foot of ice, when melted, produces 
one cubic foot of water. 

3* Some of the melted ice would remain in 
mountain lakes. 

4. The slope of shore lines is relatively con- 
stant around the world. 



75* From the information given in Figure 3, glaciers could 
form at 45 degrees north latitude provided that 
(C) 1. there is enough pressure. 

2. the altitude is 15,000 feet or higher. 

3» there are no forested areas. 

4. the temperature never gets low enough to 
prevent snowfall. 

76. What is the relationship between 

(Ap) A. Melting of the Antarctic ice sheet, and 
B. Area of North Daikota. 

1. An increase in A is accompanied by an 
increase in B. 

2. .An increase in A is accompani ed by a 
decrease in B. 

3. A and B are unrelated. 

4. The relationship cannot be determined 
from the passage. 



77 • Refer to Table 1. The ratio of water in glaciers to 
water in the ocesins is about 
(Ap) 1. i/75. 

2. 1/15. 

3. 1/8. 

4 . 1/30. 
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78. Suppose that conditions were changed so that the volume 
of water in one of the categories in Table 1 was decrea- 
sed by 500 cubic miles. In which one of the following 
categories would this decrease result in the most dras- 
tic climatic changes? 

(An) water in oceans 

2. water in atmosphere 

3* water in glaciers 

4. ground water above 12,500 feet 

79 > Which change would make Figure 1 more descriptive of 
valley glacier formation ? 

(C) 1. Add snowfall arrows to include the entire 

figure. 

2. Ilxtend accumulation line to include the 
area marked evaporation. 

3. Add snowfall arrows to include the area 
marked avalanche. 

4. Add evaporation arrows to include the area 
marked runoff c 

80. The author states that we are living in an exceptional 
era with regard to glaciation. Which one of the fol- 
lowing would substantiate this statement the leas t from 
the physical standpoint? 



(Ap) 



1 . 

2 . 

3. 

4. 



A new continental glacier is forming. 

The world is partially glaciated. 

The Arctic Ocean is open water. 

A systematic study of glaciers is taking 
place. 



GLACIERS 

(Booklet N’dmber 2) 



Directions 



Your answers to each of items 81-95 should be 
written directly on the test booklet in the space provided 
below each ltem<> Should you need additional space for an 
item write "continued” then write the remainder of your 
answer on the back of the last pa^e of the booklet. 

You received with this test booklet another 
booklet which contains the article about Glaciers. You 
may refer to it any time during the examination. You 
might wish to scan the article after you read these 
directions to refresh your memory. 



Your answers to these items will depend oi^ vour 
understanding arid thoughts about the article. Each of" you 
might write an entirely different answer to an item because 
there are many possible answers to each of them. So please 
write whatever you believe to be appropriate. 



Answers to these items do not appear as such 
^ the article. THerefore, will certaSly ansx^^er~~ 

i^ you cop^materiaf^d^^^^^ fY^im tne article . 
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81, 

(3y) 



Suppose that a glacier is advancing toward a town and 

2°’* est.-ijiiate hovr long it wUi 
t^e for it to reach the town. Briefly describe the' 
steps you would take to make this estimate! 



fifbeuS\f lr^H^fa°ls“ ^ 



?!’ V ® glacier has passed suffers con, 

(Sy) siderable damage. Briefly outline why glaciers cause 
damage and describe the kind of demage they might cause 



fglj you could detemine 

(Sy) 2.1 uiie wcxtical thickness of a glacier is increaaino> 

voi/wn-^ia^^'f * ^ method, indicate measuremSts 

tSat giaciew^m^l"'^" ®®“®»‘>er 



8i>. Suppose you knew that an 
(Sy) reach town in 12 months, 
be followed to prevevent 
the town. 



advancing glacier would 
Outline a pl.an which could 
the glacier from reaching 



86.-95. Suppose that you have been asked to evaluate the 

t write an article on Glaciers, 

Listed below are sevei*al statements which could be true 
about the author. Assyne each statemenl to be true. 

consider any r eiat ionship s which might exist 
between the statements. 

following the statement place an X 
in the space after: 

... , "-if the statement leads you to beljeve 

the author is quali.fied to write about glaciers. 

. , ”j2o^.qualified»-if the statement leads you to 

glaciers^^^ a^uthor is not qualified to write about 

, . f believe the statement write 
y^®dLf ® reason(s) why you marked 



86 . 

(Ev) 



English at a large university, 
qualifier ___ not qualified no effect 



flv\ often quoted in newspapers_and magaziiies. 

(Ev) qualified not qualified no effect 



He spent a year at Thule Air Force Ease in Greenland 
(Ev) qualified not qualified no eSect 



89 . This was the first article written hy the author 
(Ev) published in Scientific American, 



Often quoted by other glaciologists. 
(Ev) qualified _ not qualified no effect 



91 • He won a Nobel prize for his work on the ffeoloav of 
(Ev) Haiti. 

qualified not qualified > no effect 



92. He is a professor of meteorology (the study of weather^ 
(Sv) l&3^se university. ' 

-.w* not qualified no effect 



His name is not included in the Directory of American 
(Ev) Scholars . — — 

qualified not qualified no effect 



9^0 He is an amateur mountain climber. 

(Ev) qualified not qualified no effect 



95. 

(Ev) 



Is, a recognized expert in the field of electronics, 
qualified not qualified no effect 



TABLE G-1 




GIACIERB 

Percentiles* 



Haw 




Know 


ledge 




Comprehension 




Score 


9 


10 


11 


12 


9 


10 


11 


12 


20 


88 




76 


76 










19 


74 


64 


57 


53 










18 


60 


50 


42 


38 






99 


99 




48 


38 


31 


27 




99 


97 


97 


16 


39 


29 


23 


19 


99 


97 


95 


93 


15 


31 


23 


17 


14 


97 


94 


90 


88 


14 


25 


17 


13 


10 


96 


90 


85 


82 


13 


19 


14 


00 


07 


. 93 


84 


78 


76 


12 


15 


11 


07 


05 


87 


77 


70 


65 


11 


12 


08 


05 


04 


81 


69 


61 


56 


10 


09 


06 


o4 


03 


71 


59 


49 


47 


9 


06 


05 


03 


02 


61 


49 


37 


37 


8 


04 


04 






49 


37 


29 


27 


7 


02 


03 


02 . 




37 


27 


20 


19 


6 




02 




01 


26 


18 


12 


11 


? 


01 


01 


01 




16 


10 


07 


06 


4 










10 


04 


04 


03 


3 










04 


02 


01 


01 


2 










02 


01 







01 



*Percentiles computed on the per cent cf students scoring 
below a given raw score. Percentiles for this form were 
based on the fo3.1owing numbers of students: 

Grade 9 - 1223 Grade 11 - 1303 
Grade 10 - 1431 Grade 12 <• II86 
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TABLE G-2 
GLACIERS 
Percentile s 



Raw 

Score 

20 

19 

18 

17 

16 

11 

13 

12 
11 

10 



7 

6 




3 

2 



9 






33 

23 



14 

03 

04 
01 



Application 



10 


11 


12 






QO 


99 


98 


97 


96 


94 


94 


93 


90 


89 


88 


82 


82 


83 


74 


74 




65 


65 


b8 


56 


56 


6o 


47 


48 


51 


39 


4o 


42 


32 


30 


33 


25 


24 


24 


17 


17 


16 


11 


11 


09 


06 


06 


o4 


04 


03 


02 


02 


Oi 


01 


01 





Analysis 

9 10 11 12 



99 

97 


98 

96 

92 


95 

§0 


98 

n 


93 


86 


82 


81 


88 


76 


72 


68 


78 


67 


60 




67 

55 


54 

4i 




32 


41 


29 


25 


24 


27 


18 


16 


15 


18 


11 


09 


07 


09 


05 


04 


03 


03 

01 


02 


02 


01 
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TABLE G-3 
GLACIERS 
Psrceatlles 



Raw 

?”>ore 

20 

19 

18 

17 

16 

11 

13 

12 
11 

10 



7 

6 

1 

3 

2 
1 
0 



Synthesis 

9 10 11 12 





98 

97 

93 

90 



98 

96 

86 




89 

79 

65 

hS 

25 

10 





48 

32 

17 

06 




29 

15 

05 



Evaliiation 
9 10 11 12 



99 99 

99 98 97 



99 


97 


97 


94 


§3 


89 


87 


81 


78 


72 




96 

82 

72 

6o 




62 

49 

4o 

33 

2b 

21 




28 

21 

16 

12 
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TABLE G-4 

Item Data 

Glaciers 

Knowledge 



Item 

No. 



1 

2 



5 

6 

I 

9 

10 

II 
12 



15 

16 



19 

20 



Key 



4 

3 

1 

1 

3 



2 

2 



2 

2 

1 

1 

4 

1 

2 



Diffi- 

culty 



io 

89 



II 

i 



86 

89 

77 

85 

§1 

89 



V 



"2* 



.43 

il 

.45 

.57 

.46 

.58 



:p 

.41 

.57 

.46 

.52 



:i .I 

.56 

.47 .47 



Proportion Choosing 
Each Response 
12 3 4 



Omit 



>06 


.03 


.10 


.78 


.01 


.13 


.04 


.81 


.02 


.00 


.90 


.03 


.03 


.04 


.00 


,80 


.10 


.06 


.04 


.00 


C3 


.05 


.89 


.03 


.00 


■83 


.09 


.05 


.03 


.00 


,12 


.02 


.84 


.02 


.00 


C4 


olO 


• O6 


.79 


.01 


06 


.74 


.14 


.06 


.00 


06 


.80 


.06 


.08 


.01 


04 


.06 


.11 


.79 


.00 


05 


.04 


.84 


.07 


.01 


03 


•27 


.03 


.86 


.00 


02 


.89 


.02 


.07 


.00 


09 


.77 


.12 


.02 


.00 


85 


.03 


.05 


.07 


.00 


91 


.02 


.01 


.06 


.00 


03 


.05 


.03 


.89 


.00 


75 


.04 


.10 


.11 


.00 


05 


.86 


.06 


.03 


.00 



Ha^ 



i*es 



Corrected Scores 



Mean = 
S.D. = 
KR #20 = 



16.593 

3.517 

0.816 



= 15.47: 
4.1 



Mean 

S.D. = 4.67^ 

KR #20 = 0.919 



N = 5210 

“ Point-biserial correlation, raw scores 
^2 ~ *oir»t-biserial correlation, corrected scores 
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TABLE G-5 

Item Data 

Glaciers 

Comprehension 

Proportion Choosing 

Item Diff i- Each Response 



No. 


Key 


culty 


r.j* 

•JU 


V 


1 


2 


3 


4 


Omit 


21 


4 • 


.67 


.40 


.41 


.05 


.12 


.16 


.67 


.01 


22 


2 , 


.30 


.30 


.32 


.49 


.30 


.12 


.07 


.02 


25 


4 . 


.73 


.24 


.25 


.07 


.11 


.08 


.73 


.01 


27 


4 


.42 


.27 


.28 


.14 


.07 


.37 


.42 


.01 


29 


2 


=>35 


.17 


.18 


.49 


.35 


.12 


.04 


.01 


37 


1 


• 33 


.20 


.20 


.33 


.44 


.12 


.10 


.01 


40 


3 


• 16 


.26 


.26 


.70 


.08 


.16 


.05 


.01 


42 


2 


.40 


.40 


.42 


.32 


.40 


.14 


.12 


.01 


47 


1 


.63 


.42 


.43 


.63 


.16 


.10 


.09 


.02 


49 


3 


.30 


.40 


.41. 


.40 


.11 


o30 


.16 


.02 


50 


3 


.56 


.44 


.44 


.13 


.13 


.56 


.14 


.03 


51 


1 


.57 


.48 


.49 


.57 


.10 


.21 


.08 


.03 


55 


2 


.68 


.42 


.40 


.07 


.68 


.05 


,16 


.04 


58 


2 


.26 


.37 


.37 


.14 


.26 


.08 


.47 


.05 


65 


3 . 


.43 


.41 


.39 


.07 


.16 


.43 


.24 


.09 


70 


1 


.47 


.53 


.50 


.47 


.13 


.18 


.09 


.13 


72 


3 


. 58 


.55 


.50 


.10 


.10 


.58 


.08 


.15 


73 


3 


.48 


.51 


.47 


.10 


,11 


.48 


.15 


.16 


75 


2 


.42 


.46 


.42 


.12 


.42 


.09 


.20 


.17 


79 


3 


.27 


.24 


.20 


.18 


.17 


o27 


.17 


.20 



Raw Scores 


Corrected 


Scores 


Mean = 9.02 
S.D. = 3.54. 
KR #20 = 0,677 


!i II II 

0 

CVJ 


5.7^^ 

4.45 

0.815 



N = 5210 

*T2^ ss Point hiserial correlation, raw scores 
^2 * Point hiserial correlation, corrected scores 
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T/VBLE G-6 

Item Data 

Gflaciers 

Application 



Proportion Choosing 

Item Diffi- Each Response 



No. 


Key 


culty 


ri* 


rg* 


1 


2 


3 


4 


Omit 


24 


2 


.70 


.33 


.33 


.03 


.70 


.16 


.10 


,01 


28 


4 


.50 


.33 


^34 


.18 


.17 


.14 


.50 


.01 


30 


4 


.42 


.29 


.30 


.07 


.11 


.40 


.42 


.01 


31 


3 


.52 


,40 


.41 


.11 


el 6 


.52 


.21 


.01 


32 


3 


.31 


.30 


.30 


.22 


.24 


.31 


.21 


.02 


39 


4 


.43 


.50 


.51 


.38 


.08 


.10 


.43 


.01 


41 


2 


.54 


.24 


.24 


.13 


.54 


.18 


.14 


.01 




1 


.61 


.56 


.56 


.61 


.12 


.12 


.14 


.01 


44 


2 


• 65 


.57 




.10 


.65 


.09 


.14 


.02 


45 


2 


.48 


.46 


M 


.22 


.48 


.11 


.18 


.02 


46 


2 


.39 


.39 


• 39 


0 I 6 


.39 


.20 


.23 


.02 


52 


2 


.50 


.41 


.40 


.21 


.50 


.13 


.13 


,04 


5? 


2 


.48 


.41 


.40 


.14 


.48 


.13 


.20 


.05 


54 


1 


.46 


.47 


.46 


.46 


.13 


.17 


.20 


.05 


56 


1 


.42 


.47 


.46 


.42 


.22 


.15 


.16 


,05 


57 


1 


.74 


.47 


.44 


.74 


.08 


.06 


.07 


.05 


62 


1 


.57 


.55 


.53 


.57 


.10 


.12 


.14 


.07 


76 


3 


.45 


.37 


.33 


.06 


.11 


.45 


.20 


.18 


77 


1 


37 


.40 


•37 


.37 


.11 


.24 


.10 


.19 


80 


4 


.27 


.21 


.18 


• 15 


.17 


.20 


.27 


.21 



Raw Score 



Corrected Scores 



Mean = 9*80 

S.D. = 3.93 

KR ijf20 = 0.731 N = 5210 



Mean = 6.73 
S.D. = 5.04 
KR #20 = 0.857 



«ri “ Point biserial correlations scores 
rg = Point biserial correlations corrected scores 
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TABLE 0-7 
Item Data 



Glaciers. 

Analysis 



Proportion Choosing 

Item Diffi- Each Response 



No. 


Key 


culty 


r,* 


V 


1 


'2 


3 


4 ' 


Omit 






. 23 ' 


.23 


••25. 


.49 


.21 


.22 


.08 


.01 


26 


1 


.,35 


.29 


.32 


.35 


«17 


.19 


,28 


.01 




4 


.47 


.25 


.28 


.11 


.30’ 


.11 


.47 


.01 


34 


2 


.28 


.10 


.12 


.17 


.28 


.44 


.10 


.01 


35 


3 . 


.42 


=31 


«32 


.05 


.09 


<M 

• 


.44 


• 01 


It 


1 




.28 


.30 


.36 


.34 


.16 


.13 


.01 




4 


• 36 


.30 


.31 


.20 


.21 


.22 


.36 


.01 


48 


3 


.50 


.36 


• 3 ? 


.08 


.28 


.50 


.11 


.02 


§9 


3 


• 33 


.20 


.18 


.09 


11 


.33 


.41 


.06 


60 


1 


.48 


.47 


.45 


.48 


.12 


.21 


.13 


.06 


6 l 


4 


.26 


.21 


.19 


.30 


.26 


.11 


.26 


.07 






.29 


.31 


.29 


.16 


.08 


.40 


.29 


.08 


64 


3 


.58 


.53 


*49 


.06 


.17 


.58 


.12 


.08 


66 


4 


.21 


.18 


.16 


.12 


.24 


.34 


.21 


.09 


67 


1 


.23 


.27 


.24 


.23 


.11 


.12 


.44 


.10 


68 


2 


•P 




.47 


.19 


.50 


.10 


.10 


.11 


69 
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N := 5220 

~ Point biserial correlation, raw scores 
Tg — Point biserial correlation, corrected scores 
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THE LISBON EARTHQUAKE 
Directions 



This is a test of your ability to apply skills 
and understandings which you have been learning sincp vou 

asked to read a passage called 
The Lisbon Earthquake and then you will be asked to 
answer questions about it . You may refer to the passage 
at any time during the test. ^ ^ 

u answer must be marked on the ansv/er sheet 

which has been provided for you. Use only the special 

provided. Do not make any stray marks, 
yLr Lr^s^r! ' completely before marking 

Make no marks in the test booklet. 

v,/~>Tr 7 r^„-v. following is a sample question to show \'“ou 

how your answers are to be marked. Study the samole and if 
you have any questions raise your hand. 



SAMPLE 



ON SEPARATE ANSWER SESET 



1. The article you will read 
is about the 

1. Lisbon Earthquake 1, 

2. Northeast Floods 
3- Last days of World War II 
4. SpaT-' ish- American War 

Do not snenrt°a answer as many questions as you can. 

rt vou O'!® question, 

^el~ fiLoShft answer to a question, then 

St any t“rlnr?he''?estf 

Kropp and H. W. Stoker, Editors 
Department of Educational Research and Testing 
9>nd Institute of Human Lea-rning 
Florida State University 
Tallahassee 

April, 1965 

Experimental edition^ to be used only for research purposes, 
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test was constructed as part of 
research project supported by the U* S, Office of Edueatio 
under Contract Number OE-4-10-019, Project Nu^er, 2U?! 



4 v* 4-u ^opy-ight holders of the materials which aT 5 u^»a 

SoSX-'SS'tns';." ij* S’f pimwS tS' 

r;^ iSw iS'sjSy'taa** s*rjs“'g-»is?. 
. 1 “ ““““ 




THE LISBON EARTHQUAKE 



Some catastrophes demand of man far more than 
relief and rehabilitation: they literally caxl for re- 
thinking on a universal scale. This was so with the man- 
made disaster of Hiroshima. Similarly, the great earthquake 
at Lisbon on November 1, 1755> shook the minds of men. 

While controversy surrounds most statistics 
dealing with the Lisbon earthquake, there is little doubt 
that it is one of the most severe recorded, Voltaire’s 
classic description jn the story, Candide, vividly paints 
the tragic scene after the earth started to tremble under the 
feet of the people of Lisbon: "The sea rose in foaming 

masses in the port and smashed the ships which rode at anchor. 
Whirlwinds of flame and ashes covered the streets and 
squares,; the houses collapsed, the roofs were thrown upon 
the foundations, and the foundations were scattered; thirty- 
thousand inhabitants of every age and both sexes were 
crushed under the ruins." 

In all, there were three shocks. The first, 
which lasted two minutes, shook the earth so slightly that 
an eyewitness recalled that he thought it had been caused 
by a passing vehicle. Two minutes later a second quake 
was felt, and this time its violence left no doubt as to 
what it was. During its ten minute visita,tion of terror, 
the dust from falling buildings was so great it obscured 
the sun. Next came another awful tremor, and the buildings 
which still remained’ standing now came tumbling down, 
bringing added dus-, and plunging the city into total dark- 
ness. After twenty minutes of death- spelling noises, all 
became quiet. Then, to quote an eyewitness, "a very 
boisterous (stormy) wind" suddenly arose, fanning the flames 
of the candle-fed fires which had broken out all over the 
city. 



Unfortunately, a combination of circumstances 
made the disaster greater than it might otherwise have been. 
For one thing, the quake occurred on All Saints’ Day, which 
meant that candles had been burning since early morning in 
homes and churches. Then, to make matters worse, the earth- 
quake str^Jick at a bad time: shortly before ten in the 

morning — an hour when most of the people were at church. 

The violent movements of the earth caused the roofs of 
heavy stone to topple on the congregants, who, if they were 
not crushed to death, died in the flames. 
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of ’ o,.,.o,. e^cperienced all the possible elements 

fori«'^f°’^^ falling stones and fires must be added the 
forty foot tidal wave which engulfed those who rushed to the 
quays after having escaped the earlier shocks? ^rtherLrf 

® species, contributed looting and ’ 

despair. Valuable records, ifre- 

Sven?o^ exists no 

inventory of Lisbon *s art treasures of that time, we cannot 
even guess what the world has lost. cannot 

The older, medieval section of Europe’s westernmost 
was completely destroyed. So, for that matter were 
the towns within a distance of 20 leagues. "l write to vou^ 

twa^ls ® Wined a survivor? ^?or 

there Is not a habitable house left. Llsbrn has vanished’” 

Built on a more substantial foundation of basalt, the newer 
section of Lisbon survived the earthquake. 

Lisbon earthquake, whose tremors were 

No?th^AfiTo5^^^ north as Norway and as far south as 

^ profound impression on Europe Great 
Brita^ was the first to offer help. ParlSament^voted the 

hundred thousand poivJids to aid the 
victims, in addition to gifts of food and clothing. Spain 
changed her tariff laws to favor Portugal’s recoveiv. Also 
large sums of money and p.rovisions from all over E^ope were 
generously offered by sympathetic nations and individuals. 

Like today’s moral and intellectual repercussionR 
from mw-made disastrous weapons, Lisbon’s disaster registered 

ine^thtnk?vB^n? ®?^®®°Sraphs ^ f some of the outstand- 

^g thi^ers of the eighteenth centuiy. A noted historian n-p 

Portugal declares that to the little country on the Iberian 
*5® earthqu^e was "more ti,an a ca?LlyL 
(disaster) of nature; it was a moral revolutici,” 

/-.-p T 4 V So shattered was the moral and mc«,i'.,rlal structure 
of Lisbon society that it was serious^v nj^op,- 30/? that th^ 
government be transferred to Ri., de J^eiro!' the capHa^ of 
its great colony! Fortunately, the crisis brought to* ^ 

Porabal!® ^ ruthless, but exceedingly capable dictator, 

rr appointed Minister of Poreimi Affair<? anri 

K^g Jose I in 1750 and quickly established himself 
as a dominant figure in Portuguese politics. The earthauale 
provided an opportunity for h.iim to obtain complete powe? 

On the day after the earthquake he told the Chief jLtice to 



o 
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appoint a special maigistrate for each of the twelve wards of 
the city. These magistrates were given authority to carry 
out the government's emergency directives. Troops were 
rushed to Lisbon in order to maintain law and order and to 
assist in clearing up the luins. Pombal*s immediate concern 
was to prevent a plague; steps were taken to remove the 
bodies of men and animals from the ruins as quickly as 
possible, pools of stagnant waters were drained and con- 
taminated food was destroyed. A most urgent matter was 
providing food and shelter for the survivors. Food centers 
were established and field kitchens were built. Prices of 
food and building materials were strictly controlled to 
prevent profiteering. Steps were taken to prevent looting. 

On November 4 immediate public execution after a summary 
trial was ordered for those caught looting the ruins. 

Although many of Pombal*s reforms were short lived 
his great schemes and actual reforms shook Portuguese society 
loose from its medieval foundr>tions. Starting with physical 
reconstruction while Lisbon w^/s still smouldering, he built 
a new and more modem city. Temporary wooden structures 
were constructed outside the city to pro\ide emergency 
housing and governmental offices. In early 1756 Pombal 
ordered unauthorized building in stone or brick stopped and 
the city was rebuilt according to a master plan. Taxation, 
civil law and public administration were reformed, new 
industries were set up, communications were improved, 
colonial relationships were re-evaluated, and education was 
revamped. ^ Above ail, by his ensuing power conflicts with 
the nobility and the clergy, Pombal he 3 .ped Portugal advance 
on the road to a more modem society. 

Meanwhile, elsewhere in Europe numerous accc>unts 
of the great earthquake were being published in virtually all 
languages. ;ir?e than 20 reports, not including magazine 
articles, were published in I755 in England alone! The 
great philosopher Immanuel Kant took time out from his 
studies to vTTite a book on the theory of earthquakes. But 
the intellectual crisis in which Europe was embroiled for 
almost all the rest of the century took place mainly in 
Prance. Basically, the great quarrel of the age concerned 
the validity of the popular optimistic philosophy (hopeful 
outlook) of Leibniz, who believed that ^'What is, is Right," 
and that this is the "best of all possible worlds." 

Leibniz stated that man could have no free will 
in a perfect world and that "Our world is suited to our 
desires and appetites." He believed that the world was 
built on a plan which harmonizes with the moral government 



of its inhabitaoits and theorized tliat the past, present, and 
future have already been set with as much order and harmony 
as possible. Leibniz surmised that “the world must be des- 
troyed and repaired by natural means, at such times as the 
government of spirits may demand it for the punishment of 
some and the reward of others." He felt that evil tends to 
evoke a greater good in tae long run and maintained, "It is 
possible to make the world better than it is, not only as 
a whole and in general, but also for ourselves in particular.” 

Voltaire, iji his long poem, "The Lisbon Earthquake, 
vigorously attacked the Leibniz philosophy. He regarded it 
as unprogressive in that "physical evil deserved man's 
att^tion. It was also a cruel dogma, he believed, in that 
it implied that your particular misfortune is nothing; it 
contributes to the universal good.” Voltaire expressed faith 
in progress which, he said, depended upon the good sense of 
mankind. 



Leibniz, however, held that we should be content 
with the order of the past because it is in conformity with 
the absolute will of God. Although Leibniz suggested that' 
we should make the future in conformity with tne presumed 
will of God, he cautioned against becoming upset if we were 
unsuccessful. 



. ^ ^ Rousseau, in an impassioned refutation (answer), 

mainta^ed an ail is good thoine# Man must be pat3.ent and 
reco^iize evil as the consequence of his own nature , Purther- 
more Rousseau claimed that civilization had corrupted man. 
Although Rousseau looked to the past and said progress was 

expound, in his Social Contract, 
a theo^ of rule by the consent of the BGvemeTanc[ ac^Uallv 
advocated revolt by the people if they were unfairly ruled. 



returned to the 

I ray with slashing attacks on Rousseau and Leibniz for their 
views concerning human progress. Practically all the phii- 
osopners of the eighteenth centurs^ took sides in what las^ 
been called the "theology of earthquakes.” Such was the 
exchange of arguments, in fact, that the wordy Dr. Johnson 
complained that he was weary of hearing about the subject. 

^ clear-cut philosophical discussion 

f*lls our twentieth century air, we scarcely need be 
reminded once sgiain, recent catastrophes have sent 

man to meditate on life's eternal questions. Obviously, 
man -s worried about possible misuse of fission and fusion. 
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In addition. Nature, with her unlady- like 
hurricanes of recent years, and the devastatirig floods of 
the past sunnier, has intruded into what had "begun to seen 
to many like a man-manipulated world. V?hile we are. 
today, better equipped for relief and rehabilitation than 
the Portuguese were two hundred years ago, it is well to 
remember that as in the case of the Lisbon disaster, the 
Northeast floods were not even predicted, much less staved 
off. 



Nature *s calamities and their aftermath of 
re-evaluation are still very much with us. 



Adapted from 

Albert Alexander, "The Lisbon Earthquake," Social 
Education, Vol. XX, No. 1, January, 1956, pp. 27-2^7 

and 



Captation of pages 74-85 from THE LISBON 
EARTOQUAKE by T.D. Kendrick. Copyright (C) 1957 by T.D. 
Kendrick. Published by J .B. Lippincott Company. 



PRECEDING PAGE BLANK- NOT FILMED 
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pie disasters at Hiroshima and lisbon were alike in 
that both 

(K) 1. happened in the spring. 

2. were man-made. 

3* called for universal re-thinking. 

4. were earthquakes. 

Who- was the author of Candida? 

(K) 1. Kant 

2. Leibniz 

3. Rousseau 

4. Voltaire 



plat was Voltaire’s profession? 

(K) 1. orator 

2* writer 
3« painter 
4. physician 

How many earth shocks were felt in the Lisbon earthquake? 

2. 3 

3. 4 

4. 5 

How long was the first earthquake shock at Lisbon? 

Vit; If two minutes 

2. ten minutes 

3. twenty minutes 

4. thirty- two m*inutes 

^SJke^occSr?*^® following days did the Lisbon earth- 

^K) 1. All Saints’ Day 

2. Christmas 

3 • Easter 

4 . Good Friday 

^rchquLe?^ following not true of the Lisbon 

o' during evening services. 

A tidal wave also struck. 

3. The sun was obscured part of the time. 

4. It occurred about 10 o'clock in the morning. 
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8 . 



9 . 



The h^vrfest section of Lisbon survived the earthquaJ.e 

DQCcUl&0 

(K) 1. it was the most westerly part of the city. 

2. phere was only one tremor in that section. 
' it was built on a basalt foundation. 

4. there was no fire in that section. 



The 

(K) 



irst country^jjo .offer aid to Lisbon was 

1. Prance. 

2. Great Britain. ' • 

3. Norway. 

4. Spain, 



Parliament is a representative assembly in 
(K) 1. Great Britain. 

2. Norway. 

3. Portugal. 

4. Spain. 

to^helf Portugaif ~ ’'y 

(K) 1. clothing 

2. food 

3. lowering of trade tariffs 

4. money 

12. King Jose I appointed Pombal to the posJ.tion of 

i* Foreign Affairs and War. 

2. Chief Justice. 

3* Dictator. 

4 . Chief Magistrate . 




13. 



14. 



Before the 
(K) 1. 

2 . 

3. 

4. 



earthquake, Pombal was ' 
dictator of Portugal, 
dominant 

l^^fluential aiiiong the coriimon people 
a noted philosopher. 



SSce^^was earthquake Pombal -s major 

(K) 1. rebuild the city. 

2. prevent looting. 

3. provide shelter. 

; 4. prevent a plague. 




1 1 I 

1 1 i 
1 

1 1 [ 
1 1 [ 



i 

1 
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15 . 



16 . 



17. 



18. 



19. 






L-n 



Prices of food and, building material were strictly 
controlled after the earthqueike to prevent 
(K) 1. inflation. 

2. profiteering. 

3. shortages. 

4. waste. 



Persons caught looting the ruins were punished of 
execution 

(K) 1. without a fair -trial. 

by the soldiers who caught them, 
after a s\amjiary trial, 
after a long delay. 



1 . 

2 . 

t 



Lisbon was rebuilt 

(K) 1. in a haphazard manner. 

2. outside the old city limits. 

3. without.. using brick or stone. 

4. according to a master plan. 

Voltaire's poem, ’’The Lisbon Earthquake,” was an 
attack on 

(K) 1. Pombal’s emergency directives. 

2o Leibniz's philossophy. 

3. Kant's philosophy. 

4. King Jose I's lack of acti-n., 

Rousseau considered that the misfortunes resulting from 
the earthquake were nothing compared with the good which 
ultimately' resulted from it. Which one of the following 
agreed with him? 

(K) 1, Johnson 

2. Kant 

3 . Leibnxz 

4. Voltaire 
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20. Order the following statements according to the tine 
of occurrence. 

(K) A. Countries offered goods or concessions to 
aid Portugal’s recovery. 



B. A severe earthquake destroyed much of the 
capital of Portugal in 1755. 

C. A great deal of moral and intellectual di 
cussion took place concerning the earth- 



D. The rebuilding of Portugal, especially of 

the city of Lisbon, went hand in hand with 
a reform movement. 



1. B, A, D, C 

2. B, D, A, C . 

3» B, C, D, A 

B, D, C, A 

ts 



— uu uc uesirea.” 



* Workers of the World 



quake 



The correct order is 






Overseas Refugee Association 
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I 

I 

I 

I 



r 



f 



r 



1 



I 



I 



25 . 




27. 



. ♦ s 

ftrtic±6 &t«8>'t6s 'thsit/ thG 'tremors of the Llsoon 
earthquake were felt over a wide area. In which of 

the follov.ing countries were these tremors most vio- 
lent? 

(C) 1. England 

2. Germany 

3. Italy 

4 . Spain 



If the 
lowing 
(An) 



earthquake had riot occurred, which of the fol- 

would have been most likely? 

1. King Jose I would have become an absolute 
monarch « 

2. Pombal would have lost his power and 
influence o 

3. Pombal would have had a less profoiand 
influence on Portugal *s future. 

4. The Chief Justice would have become the 
most powerful person in Portugal. 



^ich of the following words might best describe 
basalt? 



(C) 1. brittle 

2. sandy 
3* solid 
4, spongy 



28. 



29 . 



W^t is the relationship between the following 
statements? ^ 

(Ap) A, Pombal *s conflict with the nobility and 

the clergy. 

B. Modernization of Portugal. 

1. A caused by B 

2. B caused by A 

3 . A and B are related, but one did not 
cause the other. 

4. A and B are unrelated. 



or at least a lower species contributed looting 
and murder to the scene of despair.” In this sentence 
lower species most nearly means 

1. non-noblemen and working men. 

2. looters and robbers. 



animals of high order, 
morally inferior men. 
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30. 



What is the 
men»;3? 

(Ap) A* 

B. 



relationship between the following state- 



Charging of unreasonable prices for rent. 
Rent control following the earthquake. 

1. A caused B. 

2. B caused A. 

3. A and B are related, but one did not 
cause the other.. 

4. A and B are unrelated. 



31. What is the relationship between the following state- 
ments? 

(Ap) A. Many ships were destroyed during the 
earthquake . 

B, Tariff regulations were changed following 
the earthquake. 

1. A caused 3. 

2. 3 caused A. 

3* A and B are related, but one did not 
cause the other. 

4, A and B are unrelated. 



32. Which of the following philosophers would have most 
likely supported Pombal's policies? 

(Ap) 1. Kant 

2. Leibniz 

3. Rousseau 

4 . Voltaire 



1 

1 

I 

1 

I 

S 

I 



I 

I 

i 





I 

I 

I 
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* * :* * * * * * * 



NOTE : The following information must be used in answering 
questions 33-35 i 

Voltaire and Leibnis miglit have argued about whether 
or not the following conclusion was true: “Great 

socjjj. ^ political , and economic reforms are needed and 
men are iustifie? / in putting ^rih their greaiesi 
‘Fffor^' in this cL frectiori . *' Decide how Voiiaire said 
Leibniz would^ha^ve used each of the followiiig statements, 
if at all, in arguing about this conclusion. Mark your 
answer according to the following key: 

KEY : 1. Voltaire would have used the statement to argue 

that . the conclusion was true . 

2. Leibniz would have used the statement to argue 



3^. All e\Gnts have been predetermined since the beginning 
of time. 



35 * Miserable conditions should. not be tolerai^d because 
man has enough common sense to overcome them. 



36 . If man were to misuse nuclear fission and fusion which 
person’s philosophy would have the least relevance? 
(An) 1. Leibniz 



that the conclusion was true. 

The statement has no bearing on the argument.. 

The statement relates to the argument but neither 
would have used it. 



33* will bring about a greater good. 

(An) 



(An) 



(An) 



********* 



2. Pombal 

3 . Rousseau 

4. Voltaire 
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37. 




39. 



Which one of the following conditions would have 
resulted in the redaction of damage to the older sec- 
tion of Lisbon? 

(C) i. The existence of a basalt foundation, under 
all of Lisbon, 

2. The occurrence of the earthquake on a non- 
. religious holiday. 



. The u. 5 e of wooden roofs for buildings. 

. The. location of the center of the earth- 
quake ten. League 8 away.. 



Which one of the following would most likely not have 

been a good Samaritan”? 

(An) 1. Kant 

2. Leibniz 

3. Pombal 

4. Voltaire 

What is the relationship between the following state- 
ments? ■ 

(Ap) A. Voltaire's poem "The Lisbon Earthquake.” 

B. Leibniz * s philosophy. 

1. A caused B. 

2. B caused A. 

3. A and B are related^ but one did not 
: cause the. other. 

4. A and B are unrelated. 



40. 



4l. 



The number of persons killed in the earthquake was 
T^doubtedly increased because stone was used for 
(C) 1, sea walls. 

2. streets and sidewalks. 

3. sidewalls of buildings. 

4. roofs of buildings. 



What is the relationship between the following state- 
ments?. 

(Ap) A. Scarcity of food. 

B. Scarcity of building materials. 

1. A caused B. 

2. B caused A. 

3. A and B are related, but one did not 
cause the other. 

4. A and B are unrelated. 
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sagn^ttet .S2^ be found in the reading pas 

!• an observef, 

2. a pfcientisti 

^3» a philosopher, 

4, an historian. 



In whav way were the results of the destruction of Hire 
sh^a s^ilai^to those of the Lisbon earthouake? 

W) 1. What Pombal did for Lisbon, the U.S, mili- 
tary government did for Hiroshima. 

The disaster led to philosophical arguments 
around the world. 

Hirohito strengthened his position in Japan 
ese government and used dictatorial pow?!*s 
to help his people. 

large nations of the world came to th»=‘ 
aid of the citizens of Hiroshima. 



2 . 



3. 



4. 



2 , 

3. 

4. 



citizens 

anJ ^ rulers were rich 

in^thA palaces, what would you do if you believed 

^ the later teachings of Rousseau? 

(Ap) 1. Urge the people to revolt against the 
rulers. 

Hrge youi^ fellow citizens to let well 
enough alone. 

Urge the government to build schools for 
the poor. 

Remind your fellow citizens that progress 
is bound to occur. 

statements best represents 
Pombal 's philosophy of life? 

(Ap) 1. What is to be will be. 

2. Might makes right. 

^d p^ishes guilty and innocent alike. 

Bury the dead and feed the living. 

Biapiitude as the Lisbon 
e^thqu^e were to occur today in a large U.S. citv. 

( p) 1, aid 'would be needed from foreign coimtries. 

self-supporting, and out- 
side aid would be unnecessary. 

3» a philosophical argument similar to Lis- 
bon's would begin. 

4. it would make headlines for a few weeks, 
then iu would be forgotten. 



I 



^TT-l MT-^IIT rsr.iZ^^-.r:: 
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^7. 



^9. 



50, 



52, 



^at is, is right," is most ne§.rly equivalent to 
(C) 1. ^what is to be, will be." 

2‘ -j’-^stlfied the means." 

3» might makes right." 

4. "the sky is the limit." 

^ medieval society discouraged 
modernization of Portugal? 

(An) 1. Political and economic power of the nobles 
and clergy. 

2. The existence of an old section in the 
towns. 

3. Great emphasis on religion. 

4. Lack of trade with other countries. 

At the t^e of the earthquake, Lisbon society could 
best be described as 

{^) 1 • enlightened . 

2. medieval. 

3. progressive. 

4. modem. 



I 



discussions of the Lisbon earth- 
quake philosophical? 

C) Few written accounts were available. 

2. There were few survivors. 

3« ^ere was no accurate means of describing 
the disaster. ^ 

4e Philosophers were the spokesmen of the time. 



51. The J^ifbon is the capital of Portugal," i 



1. a guess. 

2. not true. 

3. si;pported by the reading passage. 

4. impossible to make from the reading 
selection alone. 



the following statements is best supported bv 
the philosophy of Voltaire? r.y 



(AP) 



n 

i 

2 . 



Social welfare programs should be curtailed, 
The toerican foreigi aid program should be 
eliminated. 

People with children in school should pay 
a tax to support education. 

®dg cities should start slum clearance 
projects. 
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53 . 



54 . 



55. 



56. 



57 . 



Which of the follov^ing would most likely have done as 
Nero did- “"Piddle while Rome bumod"? 

(Ap) 1. Xant 

2. Pombal 

3. Rousseau 

4. Voltaire 

What action, if any, would Pombal probably have taken 
if most of the skilled craftsmen like carpenters and 
bricklayers had left Lisbon immediately following the 



earthauake? 
(Ap) ^ 1. 



2 . 



3. 

4. 



None, because there would have been fewer 
people to feed and shelter. 

None, because other areas needed these 
people more than Lisbon did. 

Action to return them so they could help 
rebuild the city. 

Action to return them so they could be 
planished for leaving. 



I 



(Ap) 



B. 



A "mental seismograph" is a 

(C) 1. scientific device for detecting ideas. 

2. figure of speech for the mind, 
mental record. 

mechanical device for recording earthquakes. 

What is the relationship between the following state- 
ments? 

A. There were many fires in Lisbon after the 
earthquake . 

Most of the inhabitants of Lisbon observed 
religious holidays. 

1. A caused B. 

2. B caused A. 

3. A and B are related, but one d5.d not 

cause the other. 

4. A and B are unrelated. 

What is the relationship between the following state- 
ments? ® 

(Ap) A. Scarcity of food. 

B. Control of prices of food. 

1. A caused B. 

2. B ca"'sed A. 

3. A and B are related, but one did not 

cause the other. 

A and B are unrelated. 



4 . 
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58. How could you best describe the statement that ’‘Lisbon 
has vanished? It is 
(C) i. absurd 

2 . accurate 

3. exaggerated 

4. unsubstantiated 

¥• * * * * * ,* * 

NOTE: The following information m ust be used in answering 
questions 59*6^- J 

Voltaire ajid Leibniz might have argued . about whether 
or not the following conclusion was true: Great soc ~ 

iai, political, and economic reforms are needed' an d 
are justifieH^iirpujg’On i’orth their great;es€~~'effori:; In 
this direct ion >" . . &e^c£de how Voltaire and Leibniz 
would have used each of the following statements, if at 
ail, in arguing about this conclusion. Mark your ans- 
wer according to the following key: 

KEY: 1. Voltaire would have used the statement to argue 

that the conclusion was true. 

2. Leibniz would have used the statement to argue 
that the conclusion was true. 

3» The statement has no bearing on the argument. 

4. The statement relates to the argument, but 

neither would have used it. 

59* History shows that civilizations improve over time. 

(An) 

60. Man has a responsibility to society. 

(An) 

61 c Natural disasters cause greet suffering. 

(An) 

****•!«•*** 

62. What is the relationship between the following state- 
ments? 

(Ap) A. An earthquake 

B. Tlie rise of a dictator 

1. A caused B 

2. B caused A 

3. A and B are related, but one did not 
cause the other. 

4. A and B are unrelated. 






Which one of the following statements could he attribu- 
ted to Voltaire? 

(An) 1. Research is more important than application. 

2. Benefit to man is the primary goal of science. 

3* Science serves the purpose of discovering the 

^ natural harmony and order of the world. 

4. The study of science is not a proper activity 
for man. 



Which fact about Pombal is most consistent with the 
belief that he accepted the philosophy of Voltaire? 

(An) 1. He did not move the capital to Rio de Janeiro. 

2. He was ruthless. 

3« He broke with, tradition. 

4. He used Voltaire’s poem^ "The Lisbon Earth- 
quake, as his guide to reconstruct Lisbon. 

Pombal was able to assume complete power following the 

earthquake because he was 

(C) 1. a member of the nobility. 

2. the spokesman of the people. 

3» established in the power structure of 
Portugal. 

4. well liked by the king and his court. 



V^ich of the following best describes the reason aid 
was given to Lisbon? 

{An) 1. A feeling of sorrow and charity. 

2. A desire for extra rights in rich colonies. 
3‘ A feeling of loyalty and friendship for a 
neighboring country. 

4.J a desire to establish good reiations for 
possible future benefit. 



V^ieh of the following is both a sequential relaV^cn- 
shlp and a cause-and-effset relationship? 

(An) 1, All Saints’ Day celebra.tion- -Lisbon earth- 
quake . 

2. Consideration of moving to Rio de Janeiro— 
Pombal *s rise to power. 

3* Theology of Earthquakes extensive news 
coverage of the Lisbon earthquake. 

4. The Lisbon earth quake --European a.id to 
Portugal. 



Assume that flood waters have rallied the agricultural 
area of a foreign country and millions will starve 
unless aid is received. Were he living now, which one 
of the^ following individuals would most likely advo- 
cate that U.S* surplus crops iDe made available to the 
distressed country? 

(An) 1. Keint 

2. Leibniz 
3» Rousseau 
4 . Voltaire 

Many of Pombal’s measures v;ere short lived because 



(An) 



1 . 
2 . 

i: 



they were too modem, 
they were emergency reforms, 
they were not endorsed by the clergy, 
of foreign intervention in Portugal’s 
affairs . 



In which country is the westernmost ]3uropean capital? 
(C) 1. France 

2. Norway 
3* Portugal 
4. Spain 

Which one of the following contributed most toward the 
continuing discussion of the ’’Theology of Earthquakes”? 
{Anj 1. fhe issue was very controversial and many 
philosophers were Interested in it. 

The progress of science was at stake for 
the rest of the century. 

Acceptance or rejection of Leibniz’s 
philosopiiy would govern man’s attitude 
toward his world. 

The common man’ was interested in having? a 
better life. 






3 . 



4 . 



pie greatest damage to articles such as books, tapes- 
tries, and paintings was probably caused by 
(0) 1. fire. 

2. tremors, 
xvater. 
wind. 



I: 



SVom which point of view was the passage written? 
(C) 1. historical 

2. military 
3- political 
4. scientific 



Which one of the following would, have been most likelv 
to break with “tradition? 

(An) 1. Kant 

2. . Leibniz 
3* Rousseau 
4. Voltaire 



The article states that there were four primary causes 
of death in the Lisbon earthquake. Which one probably 
took the fewest lives? 

(C) 1, falling objects 

2« fir€i 

3. murder 

4, tidal v/ave 

What is the relationship between the following state- 
ments? 

(Ap) A. A philosophical controverc^y which lasted 

the better part of a century. 

B. The Lisbon earthquake. 

1. A caused B 

2. B caused A 

3- A and B are related, but one did not 

cause the other. 

4. A and B are unrelated. 

What is the relationship between the following state- 
ments? 

(Ap) A. Spain changed i.ts tariff laws. 

B. Pombal rose to power as a dictator. 

1. A caused B 

2. B caused A 

3. A and B are related, but one did not 

cause the other. 

4. A and B are unrelated. 



^iCii one ol the following conclusions is accurately 
based upon some part of the reading passag'eF ' ' 
(An) 1. ~ - 



2 , 



4 . 



The earthquake was on Sunday. 

The Lisbon police were ineffective in main- 
taining law and order. 

The English were the only generous people 
in the loth century Europe. 

The damage would have been just as bad on 
any other popular religious holiday. 






79 . 



80. 



If the Lisbon earthqiAake had happened after Thomas 
Edison invented the light bulb, which of the following 
would have been most likely? 

(C) Ic The tidal wave could have been averted. 

2. There would have been fewer fires. 

3* There would have been a minimum amount of 

dust . 

4. The "boisterous," stormy wind would not 
have arisen. 



(Ap) A. 



B. 



What is the relationship between the following state- 
ments? 

Voltaire, Rousseau, and other prominent 
philosophers were Frenchmen. 
pie center of controversy regarding the 
Theology of Earthquakes" was in Prance. 

1. A caused B 

2. B caused A . 

3. A. and B are related, but one did not 
cause the other. 

A and B are unrelated. 



4. 



THE LISBON EARTHQUAKE 
(Booklet Nuipber 2) 

Directions 



Your answers to each of the items 81-95 should 
be written directly on the test booklet in the space pro- 
vided below each item. Should you need additional space 
for an item write "continued” then write the remainder of 
your answers on the back of the last page of the booklet. 



You received with this test booklet another 
booklet which’ contains the article about the Lisbon earth- 
quake. fou may refer to it any time during the examination. 
You might wish to scan the article after you read these 
directions to refresh your memory. 



Your answers to these items will depend on your 
understanding and thoughts about the article. Ea.ch of you 
might write an entirely different answer to an item because 
there are many possible answers to each of them. So please 
write whatever you believe to be appr'^priate. 



A nswers to these it ems do not appear as such in 
the a rticle ”r~ TRereforeTT^ will ' cer^a3nly answer 
incorrecTIy'Tf you co^py maieH^ direct^^^ the article . 
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?sv^ ®“ Innuential position in 

(Sy) Lisbon md that you were opposed to looving the capital 

J^eiro. Other influential people supported 
the proposed move. Briefly outline the reasons you 
would have used in an atten5>t to convince them that the 
capital should remain in Lisbon. 



I 



® t cartoonist wished to make the 

(Sy) phil^ophy of Leibniz appear foolish. Draw or describe 
a cartoon which would accomplish the above puipose. 



nobility opposed Pombal*s 

^nh?M?,r a member of the Portuguese 
nobility. .ji a few sentences describe why you would 
have opposed Pombal. ^ ^ 



SMss ssLs;^ ““ “* 



(iy) ^es^in°le^h*’‘^“flt? article is approximately three 
^ amclfto^f^^senSL ^“e entire 



o 

ERIC 



Ir-27 



\ 



86-95 • Suppose thai; you have been asked to evaluate the 
author clualiriGations to write an article on the 

oarthcjuake. Listed belcw are several statements 
which could be true about the author. Assume each 

^ consider s^.y relationships 
which might exist between the statements. 



qualified ^* --if the statement leads you to 
believe the author is qualified "to write 
about the Lisbon earthquake. 

you believe the statement 
leaas you to oelieve the author is not qualified 
to write about the Lisbon earthquake. 

no effect” — if you believe the statement has no 
bearing on the author *s qualifications, or lack 
of them, to write about the Lisbon earthquake. 



o 0+ ? provided below each statement write 

^swer^you^did^^^ giving the reason(s) why you marked the 



86. He wrote a book condemning Leibniz. 

(Ev) QU8rXi.fl.6d not QU&XXfi6d no Gff6Ct 



87 . 

(Ev) 



He is a professor of world history at a 
qualified not qualified no 



large university, 
effect 



88 . 

CEv) 



junici high school librarian. 
QU8rXi.xX6d _ not QusXifiod no GffGct 



89. 

(Ev) 



He ha, s never been outside the taiited States, 
qualified not qualified . no effect 
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90. 

(Ev) 



^ s 

He lived in Portugal until he was 25 years old. 
qualified .. not qualified no effect 



(eV) to teaching social studies 

qualified not qualified no effect 



/I' > wv! philosopher and has written many 

(Ev) cooks and articles. 

qualified not qualified no effect 



93. 

(Ev) 



He is a well Known .aithor of historical fiction. 
• • * * 

qualified not qualified no effect 



9^« Pombal and he were good frien^^Sc 

(Ev) qualified jiot qualified no effect 



95 o He has been blind since birth. 
(Ev) qualified not qualified 



no effect 
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TABLE i:,- ! 

LISBON EAB.THQUAKE 
Percenti les* 



Raw 

Score 



Knowledge 

9 10 11 12 





10 



7 

6 



27 

20 

15 

11 

08 

06 

04 

03 

01 



17 12 

12 09 
09 06 

06 C’f 

04 03 

03 02 

02 

01 



08 

05 

03 

02 



01 




01 



.9 



9§ 

96 

92 

8o 

71 

6o 

49 



40 

30 

22 

16 

10 

06 

03 

01 



Coir5>rehension 




based on the following nuabe?rSf 



Grade 9 - 1194 
Grade 10 - 1451 



Grade 11 - 1298 
Grade 12 - 1192 
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TABLE L -2 



LISBON EARTHQUAKE- 
Percentiles 



Raw 

Score 

20 

19 

18 

17 

16 



i4 

13 

12 

11 



10 

Q 

8 

7 

6 



1 

3 

2 
1 
0 



Application 
9 10 11 12 



99 

98 

96 

92 

88 

81 

73 



62 

52 

4o 

29 

18 



99 

97 

94 

88 

81 

74 

65 

35 

46 

36 
28 

19 

12 



98 

96 

92 






37 

27 

20 

14 

10 



81 

72 




38 

28 

20 

14 

09 

06 



11 

a4 

02 



07 

04 

02 

01 



05 

03 

02 

01 



03 

01 



Analysis 



9 


10 


11 


12 






99 


99 


99 


98 


97 


96 


98 


96 


94 


91 


97 


§s 


90 


84 




§7 


83 


76 




8i 


76 


68 


88 


75 


68 


60 


84 


68 


60 


52 


74 


60 


51 


42 


62 


51 


4l 


32 


31 




30 


22 


38 


26 


21 


15 


24 


16 


14 


06 


13 


09 


06 


OH 


06 


04 


04 


02 


02 


02 


01 






01 







] 

] 

1 

] 

{ 

1 

1 

1 

] 

i 

1 



1 

I 

1 

I 

1 

1 
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TABLE L-3 
LISBON EARTHQUAKE 



Raw 

Score 

20 

19 

18 

16 



13 

12 

11 






10 



I 



3 

2 

1 

0 



Percentiles 

Synthesis 

9 10 11 12 



Evaluation 
9 10 11 12 




preceding 
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Iten^ Data 

Lisbon Earthquake 
Knowledge 



Item 

No. 


Key 


Diffi- 
culty r^* 


% 

^2 


Proportion Choosing 
Each Response 

1234 


Omit 


1 


3 


.78 


.50 




.02 


.09 


.78 


.11 


.00 


2 


R 

• 




.47 


.47 


.02 


•P3 


.02 


.93 


.00 


3 


2 


•I? 


.40 


.40 


.04 


•7^ 


.15 


.03 


.00 


5 


2 




.33 


.33 


.04 


.84 


.11 


.01 


.00 


5 


1 




•35 


.34 


.94 


.04 


.01 


.00 


.00 


6 


1 


.99 




•?5 


.99 


.00 


.01 


.01 


.00 


T 


1 


.90 


.42 


.41 


.90 


.03 


.03 


.03 


.00 


8 


3 


.91 


•^7 


.46 


.03 


.03 


.91 


.02 


.00 


9 


2 


.90 


.44 


•?-2 


.05 


.90 


.02 


.03 


.01 


10 


1 


.91 


.46 


.46 


.91 


.02 


.05 


.03 


.00 


11 


3 


.87 


.49 


.48 


.03 


.01 


.87 


.09 


.01 


12 - 


1 


.86 


.52 


.51 


M 


.03 


.04 


.06 


.00 


}? 


2 




.32 


.32 


.35 


.50 


.09 


.05 


.01 


14 


4 


.83 


.55 


.55 


.06 


.06 


.05 


.83 


.00 


15 


2 


.90 


.50 


.50 


.04 


.90 


.04 


.02 


.00 


16 


3 




.46 


.46 


.03 


.07 


.89 


.01 


• 00 




4 


.86 


.49 


.47 


.02 


.67 


.04 


.86 


.00 


18 


2 


•§2 


•?? 


.54 


.03 


.89 


.04 


.02 


.00 


19 


3 


.00 






.07 


• 12 


.68 


.13 


.00 


20 


1 


.81 


.47 


.46 


.81 


.07 


.08 


.03 


.01 



= Point biserlal correlation, raw scores 
Tg = Point biserlal correlation, corrected scores 

Raw Scores Corrected Scores 



Mean ~ 16.96 
S.D. * 2.91 
KR #20 « 0.758 



Mean 15.95 
S.D. 3*o5 
KR #20 = 0,885 



K e 5188 



! 



i 
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T^BLE Ii^3 
Item Data 

Lisbon Earthquake 
Ccn5)rehension 



Item 

No. 


Key 


Diffi- 

culty 


V V 


21 


4 


.42 


.'+3 .44 


22 


1 


c35 


.39 .40 


25 


4 


.67 


.4,2 .42 


27 


3 


.77 


. 3 C .37 


29 


4 


.45 


.42 .43 




1 


.72 


.38 .38 


40 

42 

i 


4 

2 


.75 

.53 


.37 .38 
.43 ,2w 


ul 


1 


.63 


•27 .27 


49 


2 


.74 


.47 .48 


50 


4 




.45 .46 


51 


3 


.61 


. 36 . -6 


55 


2 

3 


.31 

.51 


.38 .38 


65 


3 


.59 


.45 M 


70 


3 


.48 


.46 .44 


72 


1 


.77 


.52 .47 


73 


1 


.59 


.45 .43 


75 


3 


.79 


.55 .50 


79 


2 


.75 


.51 .47 



Proportion Choosing 
Each Response 
3* 2 3 4 Omit 



.06 


.30 


.22 


.42 


.01 


.35 


.24 


.12 


.28 


.01 


.15 


.07 


.10 


.67 


.01 




.06 


.77 


.09 


.00 


.o 8 


.40 


.07 


.45 


.01 


.72 


.12 




.08 


.01 


.03 


.03 


.18 


.75 


.01 


.18 


.53 


.06 


.22 


.01 


.63 


.22 


.09 


.05 


.01 


.07 


.74 


.15 


.03 


.01 


.14 


.13 




.54 


.02 


.05 


.11 


e6:i 


.21 


.02 


.10 


.31 


.35 


.22 


.03 


.09 


.22 


.51 


.15 


.03 


.08 


.14 


.59 


.15 


.05 


.15 


.17 


.48 


.12 


.07 


.77 


.05 


.08 


.03 


.08 


• 59 


.03 


.18 


.11 


.08 


.04 


.04 


.79 


.04 


.09 


.05 


.75 


.07 


.03 


.11 



~ biserial correlation* 
Tg = Point biserial correlation. 



raw scores 
corrected scores 



Haw Score 

Mean = 11,96 
S.D. = 3.87 
KR #20 = 0.743 



Corrected ’Score 

Mean = 9.48 
S.D. =s 4 oil 

KR#20= o!§62 



R = 5188 



] 

] 

1 




1 

1 

1 

1 

1 

1 




"H 

J 

] 

] 

] 

1 

] 



J 



t 
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2SBEE . 
Item Data 



Lisbon Earthquake 
Application 



Proportion Choosing 



Item Diffi- Each Response 



No. 


Key 


culty 


ri* 


V 


1 


2 


3 


4 


Omit 


24 


3 


.47 


-38 


• 39 


.29 


.10 


.47 


.13 


.01 




2 


.21 


.16 


.16 


.30 


.21 


.28 


.21 


.01 


30 


• .1 


• 39 


.36 


.36 


.39 


.17 


.26 


.16 


,01 


31 


4 




.26 


.27 


.24 


.05 


.27 


.44 


.00 


32 


4 


.41 


.42 


.42 


.15 


.24 


.19 


.41 


,01 


39 


2 


.47 


.44 


.^+4 


.14 


.47 


.24 


.15 


,01 


41 


3 


.63 




.30 


.04 


.05 


.68 


.23 


.01 




.2 


.56 


.44 


.54 


.14 


.56 


.10 


.19 


• Cx 


44 

45 


1 


.50 




.35 


»50 


.19 


.11 


.19 


.01 


4 


.55 


.42 


.42 


.17 


»19 


.07 


.55 


.01 


^6 


4 


.40 


.34 


.34 


.17 


.13 


.29 


.40 


.02 


52 


4 


.46 


.54 


.44 


.25 


.12 


.14 


.46 


.03 


53 


3 


.52 


.40 


.40 


.20 


.12 


.52 


.14 


.02 


54 


3 


.75 




.44 


.08 


.05 


.75 


.10 


.02 


56 


2 


.51 


.45 


.44 


.05 


.51 


.16 


.25 


.03 


57 


1 


.74 


.46 


.44 


.74 


.09 


.11 


.04 


.03 


62 


1 


.66 


.46 


.44 


.66 


.06 


.10 


.14 


.o5 


76 


2 


.68 


.50 


.47 


.06 


.68 


.09 


*08 


.09 


77 


4 


.40 


.28 


.26 


.05 


.09 


.36 


.40 


.10 


80 


1 


.33 


.37 


.36 


.33 


.10 


.30 


.16 


.11 



*r, = Point biserial correlation, raw scores 
rg = Point biserial correlation, corrected scores 



Raw Scores 

Mean « 10.12 
S.D* ■ 3*^^ 
KR #20 = 0.689 



Corrected Scores 

Mean - 7.00 ■ 
S.D. = 4.72 
KE #20 = 0.834 



N = 5188 






I* -36 

TABLE L-7 
Item Data 

Lisbon Earthquake 
Analysis 




Diffi- 
culty r^ * i* 

•** 2 



Proportion Choosing 
Each Response 

1234 



.44 






69 

42 

4l 

48 



• 26 
.41 
.58 

T 9 

« «s.£l 

.46 



.29 .30 


.18 .23 


•'^3 .43 


.13 .12 


.25 .25 


• 23 9 ^2 


.27 .27 


.18 .41 


.50 .50 


.48 .17 


.24 .24 


.26 .21 


.43 .43 


.17 .41 


-^3 


.58 .17 


.lo .16 


•36 .33 


.50 .49 


.46 .24 



.14 

.69 

.,21 

.23 

.15 

.25 

.24 

.15 

.15 

.15 



.44 

.06 

.13 

.17 

.18 






27 

16 

09 

12 

11 





.33 


.31 


.20 


,20 


% 

38 


.47 


,46 


.11 


.48 


.47 


.46 


.22 


.14 


.37 


.39 


.38 


.37 


.05 


52 


.50 


.48 


.21 


.10 


46 




.55 


,12 


,18 


49 


.41 


.38 


.17 


.49 


21 


.06 


.04 


.46 


.13 


38 


.54 


,52 


.14 


.19 


37 


.25 


.23 


.26 


.18 



.32 .24 

.29 .08 

.38 .22 

.33 .20 

.12 .52 

.18 .46 

.16 .11 

o21 .12 

.20 .38 

.08 .37 



Omit 



.01 

.01 

.62 

.02 

.02 



.01 

.01 

.02 

.04 

.05 



.05 

.05 

.05 

.05 

.06 



.06 

.07 

.08 

.09 

.3-1 



biserial correlation, raw scores 
Tg Point biserial correlation, corrected scores 



Raw Scores 



Corrected Scores 



Mean =8.22 

SoD, = 3.60 
KR #20 = 0.684 



Mean =4.56 
S.D. = 4.58 
KR #20 = 0.824 



N = 5188 
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STAGES OF ECONOMIC GROWTH 
Directions 



This is a test of j'-ow ability to apply skills 
and imderstandings which you. have been learning since you 
entered school. You will be asked to re?id a passage called 
Stages of Economic Growth** and then you will be asked to 
answer questions about it. You may refer to the passage 
any time during the test. 

Your answer must be marked on the answer sheet 
which has been provided for you. Use only the special 
pencil that has been provided. Do not maJ^e any stray marks. 
If you make an error, erase it con5>letely before marking 
your new answer. 

Make no marks in the test booklet. 

The following is a sanrole question to show you 
how your answers are to be marked. Study the sample and 
if you have any questions raise your hand. 

sample on separate answer sheet 

1. The article you will read is 
about 

1. the stages of economic 

growth 1 , 

2. the Boxer Rebellion 
3* The Seven Years War 
4. The Spanish-American War 

You should answer as many questions as you can. 

Do not spend a great amount of time on any one questiqn. 

If you are in doubt about the answer to a question, then 
guess. Remember that you may refer to the reading passage 
at any time during the test. 




R.P. Kropp and H. W. Stoker, Editors 
Department of Educational Research sind Testing 
and Institute of Human Learning 
Florida State University 
Tallahassee 

April, 1965 . 

Experimental edition^ to be used I'or research purposes. 
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This experimental test was constructed as a part 
of a research project supported by the U.S. Office of Educa 
oion under Contract Number 0B-4» 10-019, Project Number 2117 



STAGES OP ECONOMIC GRO^OT 



<teveZop«entfankg 



I I) The traditional society 
2) The precondition for take-off 
3) The teike-off 

cs drive to technological maturity 
5; The age of high mass -con sumption 



3iven time ta®aS^lcono^1ge%apif 

"'■ ®?i«e^dustriei co^?r!buLf 
apar^"’lfcoLtLo?togV&%“VraS ' 

J“sm ScSg!„:?s “• ",:.u 



The Traditional Society 



traditional s^cfet5J/S"1S|%xisLnce"e^ 
fSI\h; factl'if t?rpoteX?m^^ 

aSl SVSar^aS" it not aviSaSror^^^^^ 

constant change in production societies undergo 

CO varies of nfw “ 00 ^^^ eo nn ®> Plagues, dlS- 

facture develop ar*d as^ricpi tn^Ai ‘^o.grees c- mrmu- 

like 

the inaccessibility of modem sclonnA 

systematic understmding of the°-'nSoinf?^ ® 

of making invention a rfguUr flSwf ^ ^ environment capable 

with food P^luction^tTOlLliy^abLrbtaff®?-^^^ s^gfioultural 
working force. Prom mnitLtion f^?f 

hlriorL’^Uf L ^*’w»2lh^a^^ towtr^i^lmving 

hands Of those who c'ontrol the la^d^wlth^'^maf pSlUcal 






role. tamily ties play a significant 

The I’re-Condition for Take-off (Transitional Period) 

is also ref^lefiras^the^trSaitf take-off, 
this period beginras a rlsulfof - 

societies. Essentially, the advancei 

Tiional society and a more modem ? ! between the tradi- 
rate of investment. The tradition«i^!*^<^? related to the 
tovestment is low (under 5S« nation^ ?°®tetv's rate of 
its rate of populatSn tocreaset ^ comparison tc 

agriculture]!'%fTortl^®and*ilocLf*over?!”d sectors— 

particularly important. erb„ad of the economy are 

to meet the^ikSy ^rffe ' n dod»i«!!‘* supply is required 

population. Agriculture muIAeirmeerthr^ «fban 

Dill i or capital dovelopment. tms can he i?" exchange 
selling surplus abroad or directly by 

Rising farm income must furnish tl^L**! «?ucing food Imports 
mental functions and fam govem- 

by men who will invest in trSe L^iod.tef*®^ ^® controlled 
reinvest their profits as producSvig risS.^^" 

money for i^ll5lnt®te°tadusSv^''°?t'^Lv ®°'»^oe of 

to gather strength and there arn'bi^hi??!®**^® industry 
a good part of the investment bills to pays therefore. 

increases in production and”exporS«on* °n“? 
chMges in productivity can m^t mad??' „^iok-yielding 
extraction and processing of natural^rtsourcS^’^^*’'^ 

^de for e dl?aionrt?Mtportati^ ~'^'~^^ outlays must be 
the like. Such investments reouirA power, and 

for pay-off, require large sums of 
benefit the community as a v/holp* generally 

government must generally plav an that 

process of providing money^for ^ ^^e 

the most important p 2 *econditinr.^ 2 ^^®'^‘ ?^®^^aad. in fact, 
itical. An effective gove« often poi- 

fiscal system which directs rpann^^^^ ^intain a tax and 

it is likely that only a viffornna^^^^-f.^^^ modem uses and 
achieve this. ^ gorous central leadership can 



VJhen the period of transition has begun, new 
types of enterprising aen come forward and show an ability 
to raise money and a willingness to take risks in pursuit of 
profit or modernization. Banks appear, investment" increases 
and modem factories spring up. The people learn to operate 
a constantly changing economic system and come to accept 
progress as not only possible, but necessary. This activity 
may proceed, however, at a limited pace within a society 
mainly characterized by traditional, low productivity 
methods, and by the old social -political values and 
structures. 



The Take-off 



In the third stage, tak.e-off, old resistance to 
steady growth is overcome and growth becom?c the normal 
condition. Take-off is concentrated within two or three 
decades and its beginning can usually be traced some 
sharp stimulus; for example, a political revolution, a 
tectoological improvement, a newly favorable international 
cnvj.rcrmciit, or a shirt to a very unfavorable position in 
terms of world trade. The most powerful single initiator 
of t^e-offs has been the railroad, which has performed the 
vital tasks of lowering internal transportation costs, 
developing a new escort sector, and leading toward develop- 
ment Ox coal, iron, and engineering industries. 



f \ following conditions are required for take- 

productive investment to 

at least 10^ of national income, (b) the development of one 
or more subst^tial manufacturing industries with a high 
rate of growth^ and (c) the existence or quick emergence of 
a political^ social^ and institutional freuoework so 
developed as to keep up a continued growth. This further 
implies a capacity for raising money from domestic sources. 



take-off usually witnesses a social, 
political, and cultural victory for those who favor 
modernization of the economy over those who wouj.d either 
cl^g to the traditional society or seek other goals. New 
^dustries expand rapidly, encouraging still other indus- 
tries, ^d increasing income in the hands of those who 
reinvest in the economy. 



Drive to Technological Maturity 

Ysars after a society ends take-off, 
technological maturity is usually achieved. During this 
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drive to laaturit ji , the siake>up of the economy changes 
constantly as technology is^roves* The economy fln.ds it 
place in international trade. Goods formerly imported are 
produced at home. New ijsport requirements develop along 
with new export commodities. Old industries levia off and 
new industries accelerate, often with a shift toward more 
complex processes such as machine tools, chemicals, and 
electrical equipment. Thus, maturity is attained when an 
economy demonstrates its capacity to move beyond the orig- 
inal industries which powered its take-off and apply modem 
technology to virtually the whole range of its resources. 

Three important r'on-economic aspects accompanv 
the development of a maturing society. 



First, the working force changes in composition, 
in real wages, in outlook, and in skills,. maturity, the 
percentage of the working force in agriculture has dwindled 
to a rlguro as low as in ©any classes* Not only does 
the urban population grow, but also there is generally an 
increase in the proportion of white collar workers, highlv 
tratoed technicians, and semi-skilled workers. These »eoPl« 
realize that they can exert power, by organizing, to achieve 
higher real wages and greater security; hence, the process 
of moving toward maturity generates social and tollti,'al 
pressures «l.dch lead toward humane modifications of the 
process. 



Second, the character of the leader ship changes 
from the industrial tycoon to the efficient professional^ 
manager of a highly bureaucratized machine. 

4.U 4 1 society as a whole takes for granted 

the miracle of inaustrialization and begins to queooion 
merits of industrialization as an overriding obiective 

These changes pose new questions concerning future 
objectives. © u u 



High Mass -Consumption 



final stage, the age of high mass- 
the society has ceased to accept the extension 
of modem technology as a primary objective. Real income 
\i^creases and so does'^the effective dema^ for 

attainPd'^fb?«®L^ mature economy. Each society which has 
attained this stage of development has struck a unique 

nni geography, resources, values, and 
political leadership, among three broad objectives^ (a) the 
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pursuit of extemAi power 5 (b) the welfare state with a 
good dead of social legislation designed to redistribute 
income^ to decrease working hours, and to increase social 
security in general; and (c) the expansion of consumer 
goods distribution. 

Since growth normally proceeds by geometric 
progression, similar to a savings account if interest is 
left to con^und with principal, the era of high mass- 
consuo^tlon will contjinue to gather momentum and vary its 
pattexns. 



il.dapted from 

W.W. Rostow, The Stages of Economic Growth. Csjmbridge 
Press, London, T96O , pp 
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Britain 



France 



Gemuny 




o Take-Off 
Maturity 
Hish 

mass'Consumption 



AltMiil e^nomic growth in sclectrd countries. Note that Canada and 



The length of each arrow indicates the length 
of the take-off stage. 



j 




The Stages of Economic Growth was written by 
(K) 1. Keynes 

2. Moore 
3* Rostow 
4. Stolurow 



According to the article, how many stages of economic 
growth are there? 

(K) i. 3 
5 
7 

10 



1 . 

2 . 

I: 



^ich of the following is in the correct order? 

(K) 1. take-off, precondition for take-off, drive 

to maturity 

2. precondition for take-off, take-off, 
traditional 

3. take-off, drive to maturity, high mass- 
consumption 

4. precondition for tadce-off, high mass-con- 
sumption, drive to maturity 

Rostow considers economic change to be the result of 
(K) 1. economic and social forces. 

2. fconomic and political forces. 

3» economic, political and social forces. 

4. ’’cold calculation” alone. 



Approximately what per cent of the labor force of a 
traditional society does work related to agriculture? 
(K) 1. 20 

2. 35 

3. 50 

4. 75 



Which stage of development is also known as the tradi- 
tional period? 

(K) 1. traditioned 

2. precondition for take-off 
3» tah;e-off 

4. drive to technological maturity 



The stage of development which frequently begins as a 
result of aggression is 
(K) 1. precondition for take-off 

2. take-off 

3» drive to technological maturity 
4. age of high maea-consumption 



I 
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8 . 



9. 



10. 



13. 



14. 
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Which stage of growth is a nation’s rate of investment 
under 55^ of its national income? 

(K) 1. traditional 

2. t{ike-off 

3. dlriv(3 to technological maturity 

4. age of hi(^ mass-consumption 

Which of the following is most likely to produce quick- 
yielding changes in productivity? 

(K) 1. building a hydroelectric plant 

manufacturing raw steel products 
manufacturing heavy equipment 
processing natural resources 



tm • 



I 



I 



Wl^dch of the following is a social overhead ejqpense? 
(K) 1. interstate highway 

2. department store 
watch factory 
farm 



precondition for take-off 
take-off 

drive to maturity 

age of high mass-consumption 



one 

two or thx'ee 
four or five 
between five and ten 

What has been the most powerful single starter of the 
take-off stage? 

(K) 1. railroads 

2. agriculture 
3* complex industries 
4. coal, iron, and engineering industries 

Tfis minimum rate of productive investment of a country 
in the take-off stage is 



11. 


The first 




condition 




(K) 


1. 






2. 

i‘ 


12. 


About 


*T. 

how 




last? 






(K) 








2. 






5, 



(K) 



1 . 

o 



I 

10 ^ 

20 !^ 
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15. Productive investment is measured as a percentage of 
(K) 1. industrial earnings. 

2. government earnings 
national income 
farm income 



I 

I 



16. How many years does it usually tal?:e a nation to achieve 
maturity after it enters drive- to -maturity? 

(K) 1. 20 

2 . 30 

3 ^ 40 

4. 60 



17. 



18. 



19. 



20 . 



21 . 



Economi.c growth usually progresses 
(K) 1. geometrically. 

2. arithmetically. 

3. logarithmically. 

4. inversely. 



Accord.lng to the chart, in I959 India was in what stage? 
(K) 1. traditional ^ 

2. precondition for take-off 

3. take-off 

4. maturity 



According to the chart, in I850 Britain was in what- 
stage? 

(K) ", . traditional 

2. take-off 

3. maturity 

4. high mass-consumption 

According to the chart, in which stage was Canada dur- 
ing the period I900-I910? 

(K) 1. traditional 

2. t£ike-off 
3» maturity 

4. high mass-consumption 

Which of the following would most likely be a major 
e^^ort from a count:ry in the transitional stage of 
economic growth? 

(C) 1. farm machinery 

2. paper products 
3* furniture 
4. crude oil 



o 



I 

I 

I 

? 



22 . 



23 . 



r 

i. 



24, 



25. 



26. 



I 

I 
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One trend appearing in the chart is that coimtries 
today ^ coE^ared ’to countries a century ago 



(C) 



1 . 

2 . 

3. 



require more time fc’/ take-off. 
seldom reach mass-consumption, 
move through the transitional stage more 
quickly. 

move from take-off to high msi.ss-consumption 
more quickly. 



2 . 



I 



Which of the following occupations would, . most teenagers 

living in a traditional society desire? 

(An) 1. factory manager 

2o farm owner 

3. hank president 

4. research laboratory director 

The statement, "two countries which violated the order 
of Rostow*s stages of economic growth were Canada and 
Austraaia” is _ 

(Ap) 1. true, according to the chart. 

probably true, but the chart does not indi- 
oatvs it definitely, 
false, according to the chart, 
probably false, but the chart does not 
indicate it definitely. 

According to the chart, in 1940 Sweden was in which 
stage of economic growth? 

(C) 1. take-off 

2. drive to maturity 

3. maturity 

4. high mass-consumption 

Tlie steam engine has been said to be the necessary foun- 
dation of the Industrial Revolution in Britain. Accord- 
ing to the information glvcm in the chart, the steam 
engine must have been invented 
(An) 1. before 1785 . 

2. between 1786 and I805. 
between I806 and 1855 . 
between 1856 and l8?5o 



I 















f 
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27 - 



28 « 



29. 



NOTE: 



30. 



31. 



According to the chart, a country can enter the stage 
of high mass-consumption 

(C) 1. only after it reaches technological maturity. 

2. without reaching technological maturity. 

3 . only after take-off has been completed. 

4. without going through the traditional stage. 

According to the chart, which of the following countries 
has probably been a major >r;xporter of manufactured goods 
over the longest period of time? 

(Ap) 1. Canada 

2. Prance 

3 . Japan 

4. Sweden 



In which stage of economic development would the produc- 
tive rate of investment most likely exceed 15^ of the 



national income? 



(C) 



1 . 

2 . 

I 



traditional 

precondition for take-off 
take-off 

drive to maturity 

* * -K- * 



The following information must be used in answering 
questions 30-31: Suppose a country exists which has 

the following four characteristics: 

a. It is very large and is controlled by a strong 
dictator. 

b. of the population are farmers. 

c. The rate of investment is about of the national 
income. 

d. The education level of the general population is 
low. 

'Inis country is like countries in the traditional stage 
in how many of the four characteristics? 

(Ap) 1. 1 

2 . 2 



This country is like coiintries in high mass-consumption 
in how many of the four characteristics? 

(Ap) 1. 0 

2e 1 

2 

. 3 



**«****■» 



EG-15 



32 . 



33. 



3 ^. 



35. 



36. 



I 



Which one of the following countries most likely has 
more than 50^ of its labor force in agricultiire at the 
present time? 

(Ap) 1. Argentina 

2. Australia 

3. Canada 

4. Sweden 

A country which ^ust built its first nubiic university 
is probably in what stage? 

(An) 1. precondition for take-off 

2. take-off 

drive to maturity 
high mass-consumption 

Suppose that in a particular country the "Jones Textile 
Company" has established three branch factories. This 
country is most likely in 
(An) 1. precondition for take-off. 

2. take-off. 

drive to maturity, 
high mass-consumption. 

Mass -hoarding of money during high mass-consumption 
would probably cause 

(An) 1. increased production of consumer goods. 

2. enactment of laws to provide higher unem- 
ployment benefits. 

3. a decrease in the number of persons 
unemployed, 

4. a reduction in the number of government 
employees . 

Which of the following occupations would be iijst in^or- 
tant in moving a coimtry into the transitional stage? 
(An) 1. lawyer 



I 



2 . 

1 : 



school teacher 
mining engineer 
electronics technician 



37 . 



In which stage of economic development is the relative 
power of the central government the weakest? 



(C) 



1 , 

2 , 

1 : 



traditional 
precondition for take-off 
t8dce-off 

technological maturity 
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38 . Suppose that in a particular country a 40-y3ar bond 
plan has just been approved for obtaining money to 
build a hydi'oelectric plant. This country is most 
likely in 

(An) 1. precondition for take-off. 

2 t take-off. 

3 . drive to maturity. 

4. high mass-consumption. 



39. 



40. 



4l. 



42 . 



Which of the following is not characteristic of a coun- 
try in the traditional stag^ 

(Ap) 1. Average family size increased over 3.ast 
year. 

2. 955^ of the land is owned by 15J^ of the 
population. 

3 . National com harvest was the largest ever. 

4. Manufacture of tractors showed a 2005^ 
increase over last year. 



In the second paragraph of the passage Keynes said 

- A II J-. . ... . 



mean? 

(C) 



as a result of cold calculation.” What did he 



1 . 

2 . 

i: 



As 

As 

As 

As 



a 

a 

a 

a 



result of a desire to improve society, 
result of objective planning, 
result of regulatory legislation, 
result of power seeking. 

The statement, ”ths last country to reach the age of 
high mass-consumption was the United States” is 
(Ap) 1. true, according to the chart. 

prcoably true, but the chart does not indi- 
cate it definitely, 
false, according to the chart, 
probably false, but the chart does not 
indicate it definitely. 



2 . 



I: 



According to the chart, 
countries probably has 



(C) 



1 . 

2 . 

3 - 

4. 



China 
Mexico 
Canada 



which one of the following 
the higjxest per capita income? 







i 




I 

I 

I 

I 

! 

{ 



f. 



r 

i: 

I 

I 



! 

f 

I 

[ 

I 

I 



! 

I 



%tf .--r- 



EQ-17 

*#♦*#*♦* 

non- 2 grlcultural 

+?n»?rf ^ total labor force each /ear in a par- 
$ 3 - 44 ^^ country, must be used in answex'ing questions 

100 ^ 

805^ 

60 % 
ko% 

2,0% 

0 



^3. 



44. 



45. 




1910 1920 1930 1940 



According to the graph, which stage of growth is 
represented by point A? srowiin is 

(Ap) 1 . traditional 

2. precondition for take-off 

3. take-off 

4. drive to maturity 

rSSfed°by‘^poSf growth is 

(Ap) 1 . traditional 

2. precondition for take-off 

3. take-off 

4. drive to maturity 

**##**#* 

The stat^ent, “of all the countries shovin on the chart 

itv*^ Interval of time between 

w^ss-consumption” is 

(Ap) 1. true, according to the cha»t. 

probably true, but the chart does not 

indicate it definitely, 
false, according to the chart. 

false, but the chart does not 
indicate it definitely. 



1: 
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46. 




48. 



49. 



Whicli of tli6 foXXowfng actions wouid do loast to niov6 
a nation from tha traditional to the t rans it ional stage? 
(Apy ic Strengthen the central government. 

2. Encourage landovmers to invest most of 
their income in industries. 



3 . ^troduce modem farming techniques to 
increase production. 

4. Reduce the compulsory retirement age. 



Which of the folxox^ing actions would most quickly move 
a country from the traditional to the transitional stase? 
(C) 1. Build a technical college. 

2. Have a war with a neighboring country that is 
in the maturity stage. 

3® Hire an outstanding scientist from a country 
in the transitional stage. 

4. Build a national system of airports. 



Suppose that in a particular country labor unions rep re - 
siting clerks and secretaries have their maximum member- 
ship. This country is most likely in 
(An) 1. precondition for take-off. 

2. take-off. 

3 . d'-ive to maturity. 

4. high mas s-consumpt lone 



Which 

(C) 



of the following countries reached maturity first’ 

1. Australia 

2. Canada 

3 . Prance 

4. Sweden 



50. 



51. 



Unionization, the labor movoaient, or the bandirg toget- 
her of workers tc protect their rights is probably most 
characteristic of which stage? 

(G) 1® traditional 

2. take-off 

drive to maturity 
high-mass-consumption 

Which of the following countries had the longest period 
of take-off? 



I 



(C) 



1 , 

2 , 

I: 



Britain 

Canada 

Prance 

Turkey 
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52 . 



53 . 



54 . 



55 . 



56 . 



statemenli^ *th©r6 will be a longer period of time 
between the take-off and maturity for China than was 
required for Britain" is 
(Ap) 1, true, according to the chart. 

probably true, but the chart does not indi- 
cate it definitely, 
false, according to the chart, 
probably false, but the chart does not 
indicate it definitely. 



2 . 

i: 



The statement, "if Britain had started its take-off 6o 
later, the ijme between its maturity and the agc'. 
of high mass-consumption would have been shorter" is 
(Ap) 1, tF:^©;, according to the chaurt. 

2. probably true, but the chart does not ir.di- 
cate it definitely. 

3. false, according to the chart, 

4. probably falsa, but the chart does not 
indicate it definitely. 



Suppose you know the following information about a 
country: 

a. half of the employed citizens are farmers: 

b. the ncr.ber of banks has doubled in the past 5 years. 

c. its chief export is wheat and its chief import is 
farm machinery. 

^is covintry Is probably in the 
(Ap) 1, traditional stage 

2. precondition for take-off stage. 

3. take-off stage. 

4. drive to maturity stage. 



^ring drive-to-maturity, labor unions wo^'id 
(C) 1, lose membership, 

2. be controlled by the government, 

3. change the social structure. 

4. increase their influence. 

’*®'‘^** “O®* lively move a 
costly from the traditional to the transitional stage? 
(Ap; 1 , discovery of a new strain of com. 

govemmem: by army 

officers. 

The establishment of a new Indus t 3 .*y to man- 
ufacture rifles. 

The building of canals to provide inexpen- 
sive transportation. 



2 . 



3 . 

4. 
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57. 



53. 



59. 



6o, 



1 . 

2 . 



Th.6 s tat 6316111/^ Australia will complatslv skip th© 
maturity stage" is x- ^ ^ ^ 

(Ap) 1, true^ according to the chart. 

probably true, but the chart does not indi- 
cate it definitely. 

false, according to the chart, 
probably false, but the chart does not 
indicate it definitely. 

Auditions econonQT most dependent on weather 

(C) 1. traditional 

2. precondition for take-off 

3. take-off 

4. drive to maturity 

a particular country the government 
likely^in^ Printing of books. This coimtry is most 

(M) 1 . precondition for take-off. 

2. take-off. 

drive to maturity, 
high mass-consumption. 

independence made up a con- 
stitution that Included the following statements; 

a. jnere will be no compulsory social security: 

will be no payments to unemployed persons: 

• the f®d®ral government will adopt a ^'hands off" 

TU 4 toward the national economy, 

jmich of the following statements would best describe 
the economic characteristics of the country? 

1. There are no large land owners. 

2. Most of the population is employed in 
industry. 

3. Over 50^ of the population are involved in 
agriculture. 

4. ©le rate of investment is 15 ^ of the nat- 
ional Income. 



I 
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6l. 



62. 



63. 



64. 



65 . 



A country that has of its population working in 
agriculture and the remainder working in heavy indus- 
tries (machines^ locomotives^ etc.) is ruled by a dic- 
tator. The coimtry has been in maturity for 60 years. 
Which of the following courses of action would probably 
lead to movement into high mass-consumption? 

(An) 1. Overthrow the dictator. 

2. Start a war with a neighboring country. 
Manufacture and sell consumer goods. 

Make the agricultural program more efficient* 



i: 



Li which stage would the occupation of “social worker” 
be the most common? 

(Ap) 1. transitional 
take-off 

drive to maturity 
high mass-consumption 



1 . 

2 . 

I: 



The movement of France and Germany from maturity to 
high mass-consumption might have been delayed by the 
(An) 1. Russian Revolution. 

2. Second World War. 

3. lack of scientific developments useful in 
industrialization . 

4. high proportion of citizens engaged in 
agriculture. 

Rostow states that vrtien scientific methods are applied 
to agriculture, the proportion of people needed in 
agriculture decreases. He leads the reader to believe 
that the disp?^aced agricultural workers will be 
(An) 1. mere or less permanently unemployed. 

2. given jobs by the government. 

3. absorbed into industrial activities. 

4. employed in agricultural activities by less 
economiically advanced countries. 

Which of the following is least characteristic of a. 
country in the stage of maturity? 

(C) 1. Half of the population is involved in 

agriculture. 

2. Demands for consumer goods exceed 
production. 

3. Factories are expanding rapidly. 

4. Heavy industry is en^hasized. 
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66. Which of the follovdng inventions probably had the most 
profound effect on the economic activities of man? 

(An) 1. water wheel 

2. steam engine 

3. telephone 

4. aiiplane 



67. 



Strong labor imions will be found only in countries in 
which stfiige(s) of development? 



(An) 



1 . 

2 . 

1 : 



high mass-consumption 
drive to maturity 

drive to maturity and high mass-consumption 
take-off, drive to maturity, and high mass- 
consumption 



68 . 



69. 



When the United States gives economic assistance to an 
underdeveloped country, that aid is least likely inten- 
ded to change the country from 
(An) 1. traditional to transitional. 

2. transitional to take-off. 



. take-off to maturity. 

• maturity to high mass-consumption. 



Take-off, according to Rostow, is brought about by a 
sharp stimulus such as those listed below. Which one 
probably started take-off in the Ikiited States? 

(An) 1. political revolution 

2. technological improvement 

3* newly favorable international environment 

4. shift to unfavorable world trade conditions 



TO. 



ijefore 

(C) 



takt 

1 . 

2 . 



off can begin the citizens must accept 
a lower standard of living, 
government control of business, 
control by the land owners, 
constant change. 



71 . 



Which of the following is the most probable reason take- 
off ended in the tkiited States it did? 

(An) 1. the Civil War started 

2. the Gold Rush started 



. the east-west railroad was completed 
. the westward e:^ansion was just getting 
under way 



I 



I 

I 

I 

I 

I 

w 

I 

I 

f 

I 

i: 

j; 



I 

i 

I 

I 

! 



f , 
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72. 



73 . 



74 . 



75 . 



76 . 



B3.se(? the info wiat ion in the chart, prohably the 
process of industrialization is least complete in 

(C; 1. Australia 

2. Canada 
Prance 
Sweden 



I: 



I: 



If progress is defined as movement from the traditional 
wtociety to the age of high mass-consunqotion, then pro- 
gress does not necessarily provide for increased 
It; 1. leisure time. 

2. material goods. 

religious dedication, 
standard of living. 

Several countries, for example, the Ifcited States and 
Prance, hay^e foreign aid programs which are intended to 
st^ulate the technical and industrial progress of 
underdeveloped nations. Which one of the followim? 

agrees best with the Sfor- 
imation ^ the reading passage. 

(An) 1. Wealthy countries are morally obligated to 
help poor countries. 

New markets and trade agreement© can be 
developed in the under-developed countries. 
World power can be gained by installing 
your political viewpoints in the under- 
developed coxmtries. 

^reign aid is a convenient way of getting 
rid of surplus products. - c» © 

According to the chart, the Canadian nation-wide rail- 
road system was probably completed about 

(C; 1, lo20 

2. 18A^0 

3 . 1900 

4o 1920 

"Turkey will never enter the stage of 
high mass-consumption" is ^ 

(Ap) 1. tl*ue, according to the ehar.^- 



2 . 

3 . 



4 . 



1 

2 

I 



ti*ue, according to the chart, 
probably true, but the chart does not 
indicate it definitely, 
false, accordiyig to the chart. 

probably false, but the chart does not 
indicate it defjjaitely. 



I 

I 









In which stage of econosaic development would the occu- 
pation of college professor” be least coamKjn? 

(Ap) ie traditional 



2. preccndition for take-off 

3. take-off 

4. drive to maturity 



One characteristic of the high mass-consumption stage 

social legislation to redistribute income* 
^ich one of the following measures would probably be 
least- useful in redistributing income? 

1, An aiJ'Tual tax that is based on income. 

2. A sales tax on all goods and services. 

3» Regular payments of money to the ur.tafaployed, 
4, An annual teoc that is the same for ail 
residents. 

^toich one of the following countries did not pass throu^ 
whe stages of economic gro? bh in the usuaT^rder? 

(C) 1. Australia 

2. Britain 

3. India 

4. United States 



cotton was the most in®ortant 
product of the South. ^Jhat is the most advanced stage 
in whicii ‘tlio pr©«^CiviX W&r Sout^ii couXd to© pyopsrXy 

1. traditional 



2. precondition for take-off 
3® take-off 
4. drive to maturity 









STAGES OP ECONOMIC GROWTH 
{Booklet Humber 2) 



Directions 



Your answers to each of items 01-95 should he 
written directly on the test booklet in the space pro- 
vided below each item. Should you need additional space 
for an item, write “continued”; then write the remainder 
of your ans\?er on the back of the last page of the booklet. 

You received with this test booklet another 
booklet which contains the article about Stages of 
Economic Giowth, You may refer to it any time durint 
the examSnation. You might wish to scan the article after 
you read these directions to refresh your memory. 

Your answers to these items will depend on 
your ^onderstaxiding and thoughts about the article. Each 
of you might write an entirely different answer to an 
item because there are many possible answers to each of 
them. So please write whatever you believe to be appropriate. 

Answers to these items do n ot appear as such 
in the article Tfie rei^rea you will cerBa^ly answer 
Incorrectly" if you'^py mat^ direciiy rrom €he article. 
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Si S’K.‘S.S«S4”';S"L°L; SS.™;- . 

ss;? gL;sr,s?lS- “• •‘•■ 

mSSir; «' ? - * 

S6**95- Suppose that you are In donhi- a>m« 4 - . 

of Rostow's theory. SLed h«Vo^ ^ ®°”“® aspects 

ments which coSd be t^nlo “ ? » several state- 

be true. & nS oonsiS^enl^m?^'^?^®^®'”®"* 
might exist b^een thf itSLentt! 

X in the space^ftert^°”^® statement place an 

Tf^tvr’gr^tl^-^^st^'Lloslow?^ theory^" 

-^®£fec^— if the statement has no 
^®ring on-your trust in Rostow's theory. 

the answer you did! ^ reason(s) why you marked 

Tm -= ‘««=r ,o, 



greater trust less trust 



no 



effect 



%v) fhllnltld^tates?"^ ^>'® P^®®i'»«nt of 

greater trust less trust no effect 



(Ev) SpLSf »'®^® developed and 

greater trust less trust no Sfect 
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89. A particular state in the United States has 805^ of its 
(Ev) population engaged in agriculture; however, the wealth 
and state governmental control are in the hands of 
several dozen large’ land owners, 
greater trust less tiiist no effect 



90. There are several poorly developed countries that have 
(Ev) been completely controlled by strong dictators for 
several decades. 

greater trust less trust no effect 



91. Mr. Rostow is a college student who wrote the article 
(Ev) as an assignment for a course in business economics, 
greater trust __ less trust no effect 



92. Several new nations are being created in Africa. 
(Ev) greater trust less trust no effect 



93* Mr. Rostow has two college degrees. 

(Ev) greater trust less trust no effect 



9^. Mr. Rostow wrote his theory and drew the chart in 
(Ev) the reading passage in 1930. 

greater trust _ less trust no effect 



United States has a surplus of agricultural pro 
(Ev) ducts. 

greater trust less trust no effect 



'TABLE EG-1 



STAGES OF ECONOMIC GROWTH 
Percentiles^ 



P.law 




IChowledge 




Score 


9 


10 


11 


12 


20 


S ? 




91 


88 




84 


78 


74 


71 

54 


18 


72 


( S 3 


58 


17 


61 


50 


45 


io 


16 


52 


kl 


35 


31 




43 


34 


27 


24 


14 


36 


29 


21 


18 


13 


30 


24 


16 


15 


12 


26 


22 


13 


11 


11 


21 


:l7 


10 


09 


10 


18 


]l4 


07 


07 


§ 


12 


].0 


06 


05 


8 


08 


07 


04 


04 


7 


05 


Ci4 


03 




6 


03 


03 


02 


02 


5 


02 


02 


01 


01 




01 









2 

1 

0 



Comprehension 



9 


10 


11 


12 






99 


98 




99 


97 


96 


99 


96 


92 


93 


97 


93 


88 


88 


95 


89 


82 


81 


SS 


84 


76 


75 


88 


77 


69 


66 


81 


69 


62 


58 


74 


62 


54 


49 


66 


52 


45 


38 




43 


36 


31 


46 


3§ 


30 


23 


3? 


26 


22 


16 


24 


17 


15 


5.0 


14 


11 


09 


06 


08 


05 


05 


03 


03 


02 


02 




01 


01 


01 


01 



-.ercsntiles coB5>ute(i on the per cent of students scoring 
below a, given raw score. Percentiles for this form were 
based on the following numbers of students: 

Grade 9 - I199 
Grade 10 - 1451 



Grade 11 - 1283 
Grade 12 - II94 
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TABLE EG-2 



STAGES OF ECONOMIC GROWTH 
Percentiles 



Raw 

Score 

20 

19 

18 

17 

16 

15 

14 

13 

12 

11 

10 



I 



Application 
10 11 12 



Analysis 
10 11 



12 



3 

2 

1 

0 



91 

96 

§2 

82 

75 

67 



24 

15 

08 

04 

01 



98 

96 

1 ) 

70 

62 

4 

'3 

26 

18 

10 

06 

02 

01 



99 

96 

92 

85 

78 

71 

62 

54 

44 

28 

20 

14 

09 

06 

02 

01 



99 

96 

91 



84 

76 


98 


ii 


98 

95 


67 


95 


91 


PI 


96 


91 


85 


46 


93 


85 


78 


38 


88 


77 


69 


31 


79 


67 


59 


24 


69 

57 


57 


49 


17 


46 


33 


11 


42 


35 


28 


07 


28 


22 


20 


03 


17 


12 


11 


01 


09 


06 


05 




03 

01 


02 


03 



9B 

Qk 



81 

73 

64 



4^ 

3^^ 

24 

15 



02 
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TABLE EG- 3 

STAGES OP ECONOMIC GROWTH 
Percentiles 



Paw 

Score 





10 



7 

6 



1 

3 

2 
1 
0 



Synthesis 

9 10 11 12 




99 99 

9§ 9d 
95 97 





96 




yf 

32 



92 

86 

76 

62 

ho 

18 



P 

87 

77 

6i 

37 

15 



Evaluation 
9 10 11 12 



99 


95 


99 


99 

98 


98 


97 


96 


97 

§2 


89 


OQ 

§5 


io 


8l 


77 


6q 


62 


59 


55 


44 





1 



i 



n 



s 



I 



I 



I 



I 



r 



: I 






(f 






. ^ 
ERIC 



1 

o 



I 

5 



6 

7 

s 

9 

10 



11 

12 

14 

15 



16 

17 

18 

19 

20 



rg 



f>RECED\N 6 PAGE BLANK- MOIBEMEO 
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TftBLE EG-4 
][tem Data 



Stages of Economic Growth 
Knowledge 



Item 

No. 



Key 



Diffi- 



culty r,* r 
1 2 



Proportion Choosing 
Each Response 
12 3 4 



3 



2 

3 



.96 

.83 

.76 

^11 

.84 



.25 .25 

ii 



c49 

.55 



0 

1 
1 
4 

1 



c8o 

.67 

•p 

.69 



•58 .57 

.59 .58 



.51 .51 






2 

2 

1 

3 

3 



•66 

.85 

^63 



57 .57 

.55 .54 



.61 .61 
.61 ,60 



.40 .40 



3 

1 

3 



3 

2 



.78 

.64 

.83 

.82 

.87 



.61 .60 

.47 .47 



.44 .44 
.42 .42 



.46 .46 



Raw Scores 



Corrected Scores 



Mea« 15.34 
S«D« 3.96 
KR #20 = 0.824 



Mean = I3.821 
S.D. = ^.28 
KR #20 = 0.924 



N«« 5143 



correlation^ raw scores 
roint oiserial correlation, corrected scores 



Omit 



.03 


.01 


.96 


.01 


.00 


.10 


.83 


.02 


.01 


.04 


.05 


.10 


.76 


.08 


.01 


.09 


.06 


.77 


a 08 


.00 


.09 


.04 


CVI 

0 

• 


• 84 


.01 


.09 


• 80 


.06 


.05 


.00 


.67 


.15 


.10 


.07 


.00 


.73 


.17 


.05 


.04 


.01 


^15 


• 10 


.10 


.63 


.01 


.09 


.10 


.07 


.14 


.01 


.12 


.66 


.15 


.07 


,00 


.06 


.85 


.06 


.03 


.00 


.78 


.08 


.06 


.08 


.00 


.09 


.03 


.83 


.05 


.00 


.23 


.07 


.63 


.07 


,01 


.10 


.06 


.78 


.05 


.00 


.64 


.11 


.11 


.12 


.01 


.04 


.10 


.83 


0O3 


.00 


.03 


•27 


.82 


.09 


oOO 


.04 


.87 


.05 


.04 


.00 



i 
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Item Data 

Stages of Ecnomic Growth 
Comprehension 



Item 

No. 




50 

51 
55 
58 

65 



70 

72 

73 
75 
79 



Key 


Diffi- 

culty 


r,* 

JL 


V 


Proportion Chocsing 
Each Response 

1234 


Omit 


if. 


.37 


.36 


• 37 


•31 


.16 


.09 


• 37 


=01 


4 




•E 


• 37 


.18 


.12 


.20 


• 50 


.01 


3 




• 42 


•7? 


•05 


•^5 


.63 


• 17 


.01 


2 

It 


• ^0 


.42 


.44 


• 19 


.40 


• 25 


• 15 


.01 


4 


.52 


.40 


.41 


•07 


.14 


• 27 


• 52 


.01 


1 


.47 


.37 


• 39 


•47 


CVJ 

CVJ 

• 


.16 


.14 


.01 


2 


=44 


.32 


^p2 


.24 


.44 


.11 


.20 


.01 


4 


= 74 


c41 


.41 


.12 


.08 


.05 


•74 


.01 


2 


.24 




.23 


.40 


.24 


.14 


• 19 


.02 


3 


.62 


o4‘i 


.43 


.08 


.22 


.62 


.05 


• 03 


3 


.41 




.34 


.11 


• 23 


.41 


.22 


• O 3 


? 


.61 


•49 


.49 


.22 


• 07 


.61 


,08 


• 03 


4 


• 58 


• 52 


• 51 


.09 


.12 


•17 


• 58 


.04 


X 


.57 

fW If 


• 57 


• 57 


•57 


.19 


• 13 


•07 


• 05 


1 


.54 


• 57 


• 55 


• 54 


.18 


.10 


.09 


.09 


4 


.52 


• 55 


• 51 


,09 


.16 


.12 


• 52 


,11 


1 


. 31 




• 30 


•31 


.10 


• 30 


.16 


.13 


3 


.31 


.42 


• 35 


.24 


.14 


•31 


.18 


.14 


3 


.27 


.2^ 


.22 


.07 


• 13 


• 27 


.38 


.15 


X 


• 55 


.5ft 


•49 


• 55 


.10 


.12 


.06 


• 17 


Raw Scores 








Corrected 


Score} s 




Mean 


= 9.61 






Mean 


«ii» 


6.48 




S«D, 

KR #20 


= 3-S 

= 0.7 


^9 




5143 


S.D. 

KR #20 




5^14 

0.867 










N = 







** ^oint hiserial correlation. 
Tg =: Point hiserial corre3.atlon. 



raw scores 
corrected scores 



ES -35 

li&BIf Ea-6 






T\n. 4* 
wc* vw» 



SflAcroct r%*P ^?/^r\r\/^\Yl4 rLver\t-rMn 

'i' VI* TV W4* 

Application 



Proportions Choosing 

Item Diffi- Each Response 

No. Key culty r^^* r * 12 3 4 Omit 



24 


1 


.68 


.50 .51 


28 


2 


.43 


. 3 ^^ .35 


30 


3 


.40 


,a8 .28 


31 


1 


.61 


.45 .46 
.54 .55 


32 


1 


.61 


}9 


4 


.45 


.43 .44 


4 l 

U 


3 
1 

4 


•? 

. 6 q 


"f- 

.43 .43 

.43 .42 


45 


1 


.74 


M .46 


46 


4 


.52 


.46 .46 


52 


2 


»39 


.30 .30 


54 

56 


2 


«43 


• 38 .37 


2 


^39 


.39 .39 


4 


o 4 i 


.33 .31 


57 


4 


.16 


.19 .18 


62 


4 


.29 


.38 .37 


76 


4 


.36 


.51 .48 


77 


1 


.51 


.52 .48 


80 


2 


.27 


.29 .26 



Raw Scores 

Mean = 9.47 
S.D. = 3.82 
KR #20 == 0.731 



00 

VO 

• 


.14 


.11 


.06 


.01 


.44 


.43 


.09 


.05 


.00 


.12 


.31 


.40 


*16 


.01 


.61 


.20 


.12 


.07 


.01 


.61 


.16 


.16 


.07 


.01 


.15 


.27 


= 12 


.45 


.01 


,07 


.07 


.79 


.06 


.01 


.36 


.27 


.23 


•i 3 


.01 




.06 


.10 


.69 


.01 


.74 


.11 


.09 


.04 


.02 


.15 


.13 


.18 


.52 


.02 


.19 


.39 


.15 


.23 


.03 


.22 


.43 


.13 


.18 


.04 


.13 


.39 


.23 


.21 


.04 


.17 


.19 


.18 


.41 


.05 


.48 


.21 


.10 


«l 6 


.05 


.18 


.19 


.27 


.29 


.07 


.15 


.24 


.09 


.36 


.15 


.51 


.14 


.10 


.09 


.16 


.27 


.27 


.18 


.10 


.17 



Corrected Scores 

Mean = 6.24 
S.D. = 4.96 
KR #20 = 0.662 



N = 5143 

*r- = Point biserial correlation, raw scores 
rp = Point biserial correlation, corrected scores 
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TABLEI EG»7 ' 

Item Data 

Stages of Economic Growth 
Analysis 



Item 

No. Key 



23 

26 

33 

34 

35 



2 

1 

2 

3 

2 




61 

63 

64 
66 
67 



68 

69 

71 

74 

78 



3 
1 

4 
4 
3 

3 

2 

3 

2 

3 

4 
2 
1 
2 
4 



Diffi- 

cuity 



Proportion Choosing 
Each Re&ponse 
12*3 4 



.58 


.38 


.42 


.11 


.58 


.27 


.24 


.26 


.27 


.26 


.26 


.18 


.18 


.40 


.26 


.35 


.18 


.18 


.10 


.27 


.29 


.23 


.25 


.28 


.29 


.32 


.20 


.21 


.10 


.37 


.21 


.15 


.16 


.21 


•23 


.39 


.35 


.36 


.11 


.16 


.14 


.08 


.06 


.36 


.24 


.41 


.40 


.39 


.12 


.26 


.30 


.27 


.24 


.35 


.12 


.50 


.41 


.37 


.08 


.50 


.47 


.52 


.49 


.18 


.14 




.51 


.47 


.12 


• 53 


.41 


.46 


.43 


.17 


.13 


.37 


•53 


.50 


.18 


.18 




.38 




.22 


• 34 


.40 


.47 


.43 


.40 


.12 


.41 


.43 




.10 


.41 


.33 


.50 


.47 


.13 


.17 



.19 


.12 




.15 


.28 


.06 




.27 


.26 


.16 


^32 


.20 


.37 


.17 


.31 


.39 


.21 


.14 


.41 


.15 


• 30 


.16 


.21 


.13 


.47 


.13 


.12 


.15 


.41 


.19 


.17 


.37 


.20 


• 13 


• 23 


• 13 


• 23 


.11 


.20 


.33 



Omit 



.00 

.01 

.01 

.01 

.01 



,01 

.01 

.02 

.05 

.06 



.07 

.07 

•08 

.09 

.09 

.10 

.11 

.12 

.15 

. 1 ? 



Raw Scores 



Corrected Scores 



Mean = 
S.D. = 
KR #20 = 



7.28 

3.26 

0.614 



Mean = 3,44 
S.D. • 4.01 

KR #20 = 0.763 



N = 5143 



*^1 ~ biserial correlation, 

r^ = Point biserial correlation. 



raw scores 
corrected scores 
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Administering the Tests 



The preparations for administering the taxonomy- type 
tests are similar to those for any standardized test. 

The tests should be administered to class room- size 
groups of students rather than to massed groups of studen' j 
as often occfurs when tests are administered in school 
cafeterias, lunchrooms, and auditoriums. The small-group 
situation will provide the examiner with a maximum of 
control and the students with a minimum of distractions. 

Tlie former is especially Important because the taxonomy- type 
tests differ somewhat in format from typical standardized 
tests aiyi the desired student responses are substantially 
different. The i.mall-group situation will enable responding 
to students* questions during the administration with a 
minimum of distraction of others. Also, it will facilitate 
proctoring the examination, a part of which should be 
observing students to n te whether they are complying \^lth 
the directions. 

Each test consists of two parts. Part A contains a 
reading passage and eighty multiple-choice items. Part B 
cor tains fifteen free-response items. Part A must be 
administered before Part B. A short break may be allowed 
between the Parts but it is not necessary to do so. 

The total time for administering each test (Parts A 
and B) is about two hours. Experience has shown that sixty 
minutes are sufficient for most students to complete Part A. 
Tile range of completion times for Part B is forty to sixty 
minutes. A time limit of fifty minutes should be announced 
for Part B. If most students finish befo'^e then, time can 
be called. If few are finished at the ena of fifty minutes, 
then the time Ijjait can be extended for ten more minutes. 

Because the content of the reading passages 'will be 
unfamiliar to students, they should be instructed to read 
the entire passage before attempting to respond to the Items, 
The administrator and/or proctors should enforce this 
instruction i It is recommended that the administrator 
remind students, while they are taking Part A, that it is 
permissible to refer to the reading passage at any time. 
Reference to the I'eading passage at any time is also per- 
mitted during the administration of Part B. 

\ 

The following materials will be required for each 
pupil for each tests (1) Part A booklet (2) Separate 
answer sheet if responses are net made directly on booklet. 



I 



1 



2 



(3) Several pencils and a special pencil if required for 
the special answer sheet (4) Part; B booklet. 

^ fh@ aduiinistrator SiiOUld have a copy of the Direc** 
tions for administering the test and copies of Part;s A and B 
of the test. 

The administrator should have some reliable method 
of keeping time^ but a stopwatch or interval timer is 
unnecessary. 

The following pages contain the set of directions 
which was used for the ejtperimental administration of the 
tests during the project. They are presenced as they were 
j^ed and as a guide for anyone who might wish to use the tests. 

They ^y be modified to fit ths situation in which the tests 
will be used. 
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INSTRUCTIONS FOR ADMINISTERING THE TESTS 
First Administration of ar.y 



Read: 



^5® going to take some tests of your 
to apply skills and understandings which you 
Since you first entered soCl! 
These tests were developed at Florida State Univer- 
sity and you are helping to establish how well the 

these^tPRtf^ school student can do on them. Because 

iJOing used for research^, it is very 
important that you do your very best on them. ^ 

7 »oftri ^^^tng each test you will be asked to 

S? article and then to answer questions about 
Jav. tests are not like most tests you have 

yof tevfttudildf specific subjects 



Read: 



Read: 



Read: 



test PiPRflo distribute the materials for the 
giveA fSthIr intIlucuS„?“ 

^sheets)^® distribution of Part A and answer 

^ou must use a number two pencil. If you do 
not have a number two pencil, raise youA handf 

(Pause) 

Now look at your answer sheet. Fill in the 

grade, school, and name 

booklet (at 
^^0 ^®sts being ^ 

instructions on the 
booklet. Follow the 
instructions as I read them aloud: 

oir-«T?« best of ycur ability to apply 

which you tove been^ 

asS entered school. You will be 

asked to read a passage called and 

You*'Jv\5«i answer-^stions about it. 

Se test^^^^^ passage at any time during 
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Your answers must be marked on the answer 
sheet which has been provided f*or you* Use oniy a 
number 2 pencil. (Your booklet says to use only 
the pencil provided, but any number 2 pencil is 
okay. Do not use any other number pencil, do not 
use ballpoint or foimtain pens , ) Do not make any 
stray marks. If you make an error, erase completely 
before marking your new answer. 

Please make no marks on the test booklet,. 

The following is a sample question to show 
you how your answers are to be marked. Study the 
sample and if you have any questions raise your hand. 

(Pause while students study sample). 

’ You should answer as many questions as you 

can. Do not spend a great amount of time on anv 
one question. If you are in doubt about the answer 
to a question, then guess. Remember that you may 
refer to the reading passage at any time during the 



When taking this test you will notice that 
the answers to some of the questions appear directly 
in the article. The answers to other questions will 
require some thinking on your part. When you have 
finished reading the passage begin answering the 

and start reading. (Students 
will have 60 minutes to read the passage and answer 
■Che questions.) 

At the end of 6o minutes say: 

'‘stop." We will now collect the answer sheets. 
Do not turn in your test booklet as you will need it 
xor ohe next part of this te ;t. 

(Collect answer sheets and dtstribu-ce Part B, do not 
collect Part A) 

Place your name, identification number, school, 
grade, and date in the spaces provided on the booklet. 
We will now read the instructions for this test. 



answers to each of items 81-95 should be 
direcTjly below each item. Should you need 
additional space for an item write "continued" then 
write the remainder of your answer on the back of the 
last page of the booklet. 
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You received with this test booklet another 
booklet which contains the article about 
You way refer to it at any time during the exajnina- 
tion* You might wish to scan the article after you 
read these directions to refresh your memory. 

Your answers to these items will depend on 
your understanding and thoughts about the article. 

Each of you might write an entirely different answer 
to an item because there are many possible answers to 
each of them. So please write whatever you believe to 
be appropriate. 

Answers t o these itenio do not appear as such 
in the article. Therefore j y ou will certainly answer 

i^ you copy ^He material directly from 
the article — 



^ Note to Atitaii^strator ; The range of completion 
times for i^rt B is forty to sjjcty minutes. A time 
limit of fifty minutes should be announced for Part B. 
If most students finish before then, time can be 
called. If few finish at the end of fifty minutes 
then the time limit can be extended for ten more 
minutes. 



At the end of 50 minutes say; Stop, Wo will 
now collect the test you have just completed. 

(Collect Part A and Part B separately) 



INSTRUCTIONS FOR ADMINISTERING THE TESTS 

Second, Third, and Fourth Administrations 

This IS similar to the other one(s) you 
have taken in this series. You will again be asked 
to read an article and answer questions about it« 



1: _We will now distribute the materials for th^^ 

■cest. i^iease leave them on yoixr desks until you 
are given further Instruction. (Allow time for 
distribution of Part A and answer sheets) 

I* You must use a number two pencil. If you 

do not have a number two pencil raise your hand. 
(Repeat the appropriate directions from the 
previous page,) 
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Scoring the Tests 



Two types of student responses are elicited bv sarh 

multiple-choice anf " 

rart B IS free-response. 

IT ■, ^ ^ requires four scoring kevs— 

Comprehension, Application, and Analysis.^ 
can be constructed readily from the following 
tables which contain for each form, the item number, the ^ 
keyed response, and the taxonomy level. For scoring small 
numbers of answer sheets, a punch matrix overlay and hand- 
scoring will be feasible. For large numbers of answer 
sheets, IBM 1230 or Digitex special scoring keys, or computer 
programs will be more feasible and economifal lhan LSorlng, 

^ 4 . ® elicit written responses from 

famil?»r'with®+h I’y Judges who are thoroughly 

processes of Synthesis and Evaluation, the 
reading passages, and the pertinent items. ’ 

oe recommended that the scoring be done by teams 

Judges each. They should first become 
knowledgeable about the tests and p’' ^cesses described annvA 
A?!" should become equally faL.iliar with the scoring ’ 

scored sample responses which appear in this 
appendte. Then, a sample of responses should he drawn from 
those they will score and these should be scored independ- 

reliabilities should be 
4 *^® of it is unsatisfactory, then 

facto should be give to them. When a satiS 

agreement is attained, then scoring should 

quality control studies be done 
mintained^^ during scoring to assure that this level is 



The scored responses which are included here for each 
quality level of each item of the four forms should be heln- 
to Judges during training and when they are actually 
rating responses. However, It should be noted thS these 
are merely a sample of the responses which students ac 4 ,jaiiv 
gave to the items. Undoubtedly, different SspoSsL wm ^ 
be commonplace. Therefore, the principles undSrlyw the 
scoring procedures will be much more valuable than specific 
knowledge of how each sample item was scor^^d. 

for scorS/p2rf°A ”®°®®sary information 

lor scoring r&Tz A of sacn form is provid 0 df=. tt 

definitions of Synthesis and Ei^^aluat ion "along 

which determine the score for 

item, ^ Sections III through VI contain scored samnls 

foS^forms!”*" Evaluation items for each of the 
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SECTIOit I 



Key 

Atomic Structure 
Part A 



Item Correct Process Item Correct Process 

Number Response Level Humber Response Level 



1 


1 


Knowledge 


2 


1 


Knowledge 


3 

i . 


. 2 


Knowledge 


4 


3 


Knowledge 


§ 


2 


lOiowledge 


6 


2 


Knowledge 


7 

A 


4 


Knowledge 


8 


3 


Knowledge 


9 


4 


Knowledge 


10 


2 


Knowledge 


il 


4 


Knowledge 


12 


2 


Knowledge 


13 


3 


Knowledge 


14 


1 


Knowledge 


15 


1 


Knowledge 


16 


4 


ICnowledge 


17 

18 


1 


Knowledge 

Knowledge 


19 


1 


Knowledge 


20 


2 


Knowledge 


21 


1 


Comprehension 


22 


3 


Comprehension 


23 


1 


Analysis 


24 


1 


Application 


?§ 


3 


Comprehension 


C > 

27 

28 


1 

1 


Analysis 

Comprehension 

Application 


29 


4 


Comprehension 


30 


2 


Application 


31 


4 


Application 


32 


3 


Application 


il 

II 


2 

4 


Analysis 

Analysis 


1 


Analysis 


36 


i 


Analysis 


^7 


2 


Comprehension 


ovooc 


4 

1 

4 


Analysis 

Application 

Comprehension 



7 



4l 


1 


Application 


42 

1 . 


4 


Comprehension 


U 


3 

1 


Application 

Application 


4 


Application 


46 


3 


Application 


47 

ft 


2 


Comprehension 


48 


2 


Analysis 


49 


1 


Comprehension 


50 


3 


Comprehension 


51 


1 


Comprehension 


52 


2 


Application 


5^ 

il 


2 

2 


Application 

Application 


4 


Comprehension 


5o 




Application 


56 


1 


Application 


2 


Comprehension 


§9 


2 


Analysis 


60 


3 


Analysis 


6l 


1 


Analysis 


62 


1 


Application 


% 


4 

2 


Analysis 

Analysis 


3 


Comprehension 


66 


1 


Analysis 




4 


Analysis 


66 


4 


Analysis 


69 


2 


Analysis 


70 


2 


Compiehension 


71 


4 


Analysis 


72 


4 


Gompr(»hension 


I? 


3 


Compr<5hension 


74 


1 


Analysis 


Zl 


4 


Comprehension 


76 


3 


Application 


TL 


2 


Application 


76 

^0 


3 

1 


Analysis 

Comprehension 




3 


Application 



J 
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Key 

Glaciers 
Part A 



Item Correct 
Number Response 



Process 

Level 




^ Knowledge 
3 Knowledge 
1 Knowledge 
1 Knowledge 
3 Knowledge 

1 Knowledge 
3 Knowledge 
^ Knowledge 

2 Knowledge 
2 Knowledge 



11 

12 

15 

16 

17 

18 

19 

20 



4 



2 

2 

1 

1 

4 

1 

2 



Knowledge 

Knowledge 

Knowledge 

Knowledge 

Knowledge 

Knowledge 

Knowledge 

Knowledge 

Knowledge 

Knowledge 



21 

22 

23 

24 

25 

26 

27 

28 

29 

30 



4 Comprehension 

2 Comprehension 

3 Analysis 

2 Application 

4 Comprehension 

1 Analysis 

4 Comprehension 

4 Application 

2 Comprehension 

4 Application 




3 Application 

3 Application 

4 Analysis 

2 Analysis 

3 Analysis 

1 Analysis 

1 Comprehension 

4 Analysis 

4 Application 

3 Comprehension 



Item Correct Process 

Number Response Level 



41 

42 

^3 

44 



45 

46 

47 

48 



49 

50 



2 Application 

2 Comprehension 

1 Application 

2 Application 

2 Application 

2 Application 

1 Comprehension 

3 Analysis 

3 Comprehension 

3 Comprehension 



51 

52 

5 

55 

56 

57 

58 

59 

60 



1 Comprehension 

2 Application 

2 Application 

1 Application 

2 Comprehension 

1 Application 

1 Application 

2 Comprehension 

3 Analysis 

1 Analysis 



61 

62 

63 

64 

65 

66 

67 

68 

69 

70 



4 

1 

4 

3 

3 

4 
1 
2 
4 
1 



Analysis 

Application 

Analysis 

Analysis 

Comprehension 

Analysis 

Analysis 

Analysis 

Analysis 

Comprehension 




7R 

76 

7? 

78 




2 Analysis 

3 Comprehension 

3 Comprehension 

4 Analysis 

2 Comprehension 

3 Application 

1 Application 

2 Analysis 

3 Comprehension 

4 Application 



8 




I 

i 

I 

I 

f 

■m 

% 



I 



Xm 



li 

i: 



II 



I 

f 

t 

I 

I 



Aey 

Lisbon Earthquake 



Part A 



Item Correct Process 



Number 


Response 


Level 


1 


3 


Knowledge 


2 


4 


Knowledge 


3 


2 


Knowledge 


4 


2 


Knowledge 


§ 


1 


Knowledge 


D 


1 


Knowledge 


7 


1 


Knowledge 


8 


3 


Knowledge 


9 


2 


Knowledge 


10 


1 


Knowledge 


11 


3 


Knowledge 


12 


1 


Knowledge 




2 


Know.ledge 


14 


4 


Knowledge 




2 


Knowledge 


16 


3 


Knowledge 


17 

•n o 


4 


Knowledge 


18 


2 


Knowledge 


19 


3 


Knowledge 


20 


1 


Knowledge 


21 


4 


Comprehension 


22 


1 


Comprehension 


23 


4 


Analysis 


24 


3 


Application 




4 


Comprehension 


2o 


3 


Analysis 


27 


3 


Comprehension 


28 


2 


Application 


29 


4 


Comprehension 


30 


1 


Application 


31 


4 


Application 


32 


4 


Application 


33 


2 


Analysis 


34 


2 


Analysis 


35 


1 


Analysis 


30 


1 


Analysis 


37 


1 


Comp rehen s ion 


38 


2 


Analysis 




2 


Application 


40 


4 


Comprehension 
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Item 

Number 


Correct 

Response 


Process 

Level 


4l 


3 


Application 


42 

I* A 


2 


Comprehension 


?,? 


2 


Application 


44 


1 


Application 


45 


4 


Application 


46 


4 


Application 


47 


1 


Comprehension 


48 


1 


Analysis 


^9 


2 


Comprehension 


50 


4 


Comprehension 


51 


3 


Comp rehen sion 


52 


4 


Application 


53 


3 


Application 


54 


3 


Application 


55 


2 


Comprehension 


56 


2 


Application 


57 


1 


Application 


58 


3 


Comprehension 




4 


Analysis 


60 


1 


Analysis 


61 


3 


Analysis 


62 


1 


Application 


63 


2 


Analysis 


64 


3 


Analysis 


65 


3 


Comprehension 


66 


1 


Analysis 


67 


4 


Analysis 


68 


4 


Analysis 


69 


2 


Analysis 


70 


3 


Comprehension 


71 


3 


Analysis 


72 


1 


Comprehension 


I? 


1 


Comprehension 


Ih 


4 


Analysis 


75 


3 


Comprehension 


70 


2 


Application 


77 


4 


Application 


78 


4 


Analysis 


79 


2 


Comprehension 


80 


1 


Application 



^ <•9^ ' «--rrr 



1 






Key 

Economic -Growth 
Part A 



Item Correct Process 

Number Response Level 



1 

2 

I 

i 

l 



9 

10 



11 

12 

14 

15 

16 



19 

20 



21 

22 

23 

24 

i 

29 

30 




3 


Knowledge 


2 


Knowledge 


3 

1 


Knowledge 

Knowriedge 

ICnowrledge 


2 


Knowriedge 


1 


Knowriedge 


1 


Knowriedge 


4 


Knowriedge 


1 


Knowriedge 


2 


Knowledge 


2 


Knowriedge 


1 


Knowledge 


3 


Khovfledge 


3 


Knovfledge 


3 


Knowledge 


1 


Knowledge 


3 


Knowledge 


3 


Knowledge 


2 


Knowledge 


4 


Comi^rehens ion 


4 


Comp rehens ion 


2 


Analysis 


1 


Application 


3 


Comp rehens ion 


1 


Analysis 


2 


Comp rehens ion 


2 


Application 


4 


Comprehension 


3 


Application 


1 


Application 


1 


Application 


2 


Analysis 


3 


Analysis 


2 


Analysis 


3 


Analyj^is 


1 


Comprehension 


1 


Anal5rsis 


4 


Application 


2 


Comprehension 

10 



Item Correct Process 

N^^er Response Leve l 




49 

50 



3 Application 

4 Comprohension 

1 Application 

4 Application 

1 Application 

4 Application 

2 Comprehension 

4 Analysis 

3 Comprehension 

3 Comprehension 



51 

52 

54 

56 

57 



59 

60 



3 Comprehension 

2 Application 

2 Application 

2 Application 

4 Comprehension 

4 Application 

4 Application 

1 Comprehension 

4 Analysis 

3 Analysis 



61 

62 

63 

64 



65 

66 

67 

68 



69 

70 



3 Analysis 

4 Application 

2 Analysis 

3 Analysis 

1 Comprehension 

2 Analysis 

3 Analysis 

4 Analysis 

2 Analysis 

4 Comprehension 



71 

72 

73 

74 



7§ 

76 

77 
76 

P 

80 



1 Analysis 

1 Comprehension 

3 Comprehension 

2 Analysis 

3 Comprehension 

4 Application 

1 Application 

4 Analysis 

1 Comprehension 

2 Application 









SECTION II 



Definition of Syn thesis^ 



Synthesis is defined as putting together of 
elements and parts so as to form a whole. The task of 
the student is to combine certain e3.cments to constitute 
a pattern of structure not clearly there before. It will 
generally be necessary for the student to combine parts 
of the reading passage with generalizations from their 
prior learning in order to form a well integrated product. 

Essay questions, as used in achievement and aptitude 
tests, generally require only the expression of remembered 
ideas and inteip relation of given materials. Synthesis 
responses require uniqueness and originality, requiring 
the student to draw upon elements from many sources to 
construct a new product instead of studying a simnle whole 
and merely reproducing elemerxts of that whole. Compre- 
hension, Application and Analysis are, of course, involved 
in a synthesis product, but products stopping at any of 
these levels are partial products and are less complete 
than the desired product. 

There are three different kinds of Synthesis, which 
are on the basis of the product required by the task. These 
are (1) production of a unique communicatio n. (2) production 
of a 2lan_q r proposed selT of operations , production 

of a set of ab stract reTitBEsT 

A ^ique communicat ion , is a product through which 
the student is trying to communicate his ideas and experiences 
to the reader. The mode of expression is less conventional 
than the typical essay question requires and may be in the 
form of a cartoon or illustration, or a descriptive story or 
essay. The key is the effectiveness with which the student 
usec' the particular mode of e^qpression. The mode also sets 
limits within which the student must accomplish the purposes 
set by the task. 



The second type of product is a plan or proposed set 
ol operations . The product must satls?TW ^ e ^T^»ements ' of 
the cask which are usually in the form of data or specifica- 
tions to be taken into account by the student. The reQU'’re— 
ments of the task furnish a rather well-defined criterion 
against which the student’s product may be evaluated. The prod 
pet must not be viewed strictly by preconceived standards 
however, because a student may conceive of a plan or process 
that is uniquely his own. 



"^The material in this section is based on the 
discussion of Synthesis in Part II, Section 5 of the 
of Educational Objectives, Handbook I, Bloom, et al. 



Taxonomy 
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The third type of S;^mthesis product includes 
objectives that require the student to produce, or derive 
a set of abstract relations. The student may begin with 
concrete data which he proceeds to classify or explain, or 
the student may begin with some basic proposition and deduce 
other propositions or relations. In either case the product 
must fit the facts, adequately account for seemingly unrelated 
phenomena, and reason out the task in terms of given infor- 
mation, The task permits the student to carry his thinking 
quite far, but the specific information creates a rigorous 
objective criteria which his product of Synthesis must meet. 



Response Characteristics 



Synthesis items are scored on a scale ranging from 
0 to 4. The general characteristics of the responses in 
each category are presented below. 

Score 0 A response which shows no attempt to complete 

the task set forth in the item. This would include 
responses which consist entirely of copied material, 
of the problem posed, take issue with the "facts" 
of the item, or show erroneous interpretation of 
the task, 

-Score 1 A response v/hich would indicate that the subject 
has a basic understanding of the task at hand. 

This would include responses which are mere listings 
of the elements of solution of the task, mostly 
copied material which includes a statement of its 
relation to the task, or are a broad general’ state- 
ment of the solution. 

-Score 2 A response which indicates that the subject 
has a basic understanding of the task and gives 
a relatively complete response to one part of the 
task. This would include a response which shovjs 
the relationship between two basic aspects of the 
task or which shows extension of one element well 
beyond the information contained in the passage. 

A response in this category may contain erroneous 
assumptions based on illogical inteipretation of ' 
the reading material. 

3 A response which shows considerable extension 
of the material contained in the reading passage. 

The response must clearly indicate the relationship 
between two or more element s of the task^ or in 
those items which require a digest of the material. 



must cover ail major aspects of the passage. 

Unlike lower level responses it cannot contain 
erroneous interpretaions of the reading passage. 
However, it may contain some irrelevant material. 

A response which shows considerable extension 
of the material in the reading passage and combines 
this extension with a novel application of prior 
knowledge. The response must clearly indicate the 
rels.tionship between all parts of the task and 
unlike lower level responses cannot contain 
irrelevant material. In those items which reouire 
a digest of the reading passage the product must 
indicate that the student has combined several 
specific elements into general elements which 
when combined digest che entire passage. 



Definition of Evaluation^ 



defined as the making of judgments 
about the value, for some purpose, of ideas, vjorks, 
solutions, methods, material, etc." (Bloom, et al, 1956, 
p. Ib 5 ). These judgments involve the use of cri'^eria which 
may be determined by the student or given to him. Thus 
evaluaoion differs from the other behaviors defined in 

the j^xonpmY evaluative behaviors must be based on 

a definite criterion. 

^ 4 4 judgments made by an individual are quick 

decisions which are not preceded by a deliberate consider- 
the different aspects of the thing being judged, 
xnese judgments are more properly labeled opinions since 
they are not based on an objective criterion, and as such 
cannot be properly labeled evaluation as defined in the 
Taxonomy. For the purpose of scoring items, only those 
responses which show definite evidence that the student 
based his judgment on a criterion, stated or unstated, 
should be classified as evaluation responses# 

4-v. j^aluations may be of two distinct types in that 

they may be based on internal or external criteria, 
^valuations made on the basis of internal standards. , . 
are for the most part concerned with tests of the accuracy 

consistency, logical accuracy and 
the absence of internal flaws." (Bloom? p. l86). Evaluations 



^a-iiSrial in this section is based on the Dis* 

Taxonoin^r of Educational 



Objectives Handbook I . B1 



Cm 
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Blade on the basis of external criteria are niade using 
standards arrived at by considering the ends to be served 
by the thing being judged. Evaluation, as measured by the 
laxong\| tests require judgments on the basis of external 



Response Characteristic? 



]^r the most part, the items will present “facts” 
concerning authors of the reading passage with the students 

effect such facts would have on 
the authors qualifications to vfrite such an article. The 
standards on which the Judgments are made must he supplied 
hy tne student in that he will be required to set up a 
^othetical author in his own mind and relate the ^facts'' tc 

Eaturally the qualifications of 
pis hypothetical author need not be stated by the student. 

^ construct will be evident in the 

noLw fr® related to the qualifications. 

Scoring of the responses will therefore be accomplished by at 
evalupion of the extensions made of the"facts" presentedf 

words the evidence of a criterion will be determined 
by whether or not the study makes an extension of the facts. 

Economic Growth, the items per- 
^ the validity of the economic theory presented in the 

articp. The process in this test is the same as the others 
pcept the critepa is the applicability of the theow in tte 
instances suggested by the "facts" of the items. ^ ® 

« 4 . .. Ev^uatlon items are scored on a scale ranging from 
0 to 2. The general characteristics of the responds in 
each category are presented below. 



Score 0 



Score 1 



Does not relate statement to criteria, 
^dicates that the student did not accept the 

^ statement 

with no statement indicating basis of 
judgmeno. No indication that the student was able 
oo fomulate a relationship between "facts” and 
qualifications or fonnulate a basis for no 
relationship. Student missed an important implica- 

"-act" Student missed Important 

.tact contained in reading passage. (This is 

f Stages of Economic 

Growth). Student generalises accomplishments in 
one area to accomplishnent in all areas. 

Shows basic relationship between "facts” given 
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in the question and relates them to criteria. 
Logically extends basic implication of “fact" 
and states opinion on the basis of this extension. 
States criterion used and states how the “fact” 
given relates to the criterion (this type of 
answer frequently found for "no effect” answers). 
Attempts to answer items without extension of 
the "facts" given and arrive at no effect due to 
insufficient information. 

Makes logical extension of "facts" presented 
and arrives at a Judgment based on a resolution 
of conflicts between the extensions. Acknowledges 
information necessary to form an evaluation is 
missing, makes a supposition plus extension of 
"facts” presented. Translates entire article into 
a general category and translates "facts" presented. 
Translates entire article into a general category 
and translates "facts" given into sp.,cific 
attributes and makes an evaluation based on these 
translations (this type of response is common for 
items concerned with profession of author) . 

Indicates Judgment based on global aspects of 
the "facts" but points up assumptions basic to 
this Judgment. . 




Scored Sample Responses 
Atomic Structure 



Item 8l . A chemist claims that he was able to make a 
sample of xenon, a member of the Zero Group, 
combine with fluorine. Briefly explain what 
might have happened to produce this result. 

Objective; The student should recognise that the chemist 
must have made an error and had an impure sample 
or that some powerful process was devised to ‘ 
force the reaction, because accordiing to the 
article Xe will not combine with anything. 

Examples Score 0 



It will e^qolode. 

If the chemist had combined an inert element of 
the zero group with fluorine, there would have 
been no reaction. 

He just discovered a way to malce them unite, but 
it hardly seems possible after everything else 
that was tried failed. 

They will not unite because the article says that 
even Fluorine, most violent of <ill the non-metals, 
cannot shake these hermit elements out of their 
inertness. 



Examples Score 1 



Probably extreme heat or pressure was exerted upon 
xenon, because zero groups do not normally combine. 

Since the xenon was a gas it could have turned into 
a liquid and then combined with fluorine. 

Evidently, the element he thought xenon was another 
element . 

Perhaps he could produce a xenon ion that would 
combine with fluorine whereas the“SIbm would not 
react with fluorine. 
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’pme only possible means of makirig an inert gas combine is 
to eliminate one of the electrons, which woiild make the 
gas unstable* This may happen in ^n atomic bomb or other 
nuclear force.. 



Exa mples Sc ore 2 



An electron of the xenon has been either gained or lost 
before the trial. The xenon, then is not xenon, as the 
cheiaist believes. 

Ke probably had to use an extreme high temperature or a lot 
of pressure. He might have been able to make it by com- 
bining two elements, or by baking away or adding protons 
or electrons from a higher or lower group. 

llie sample Xe must have been impure and the fluorine 
combine with the impurity. This is ridiculous because 
the chemist would control his experiment better than that 
and never make sure a claim. 

The Xe was probably a weaker member of the zero group and 
a small quantity was mixed with the fluorine which was 
strong and a greater quantity was used which enabled the 
two to combine. 



Exan^les Score 3 



Table 2 shows that there are missing elements at the end 
of the chart. He could have discovered one of these 
elements and used it as a catalyst, which would combine 
i"lth both the fluorine and xenon and form a three-element 
compound. 

First of all, assuming that the chemist was’ qualified and 
had!i*t made a mistake in his wnrk or allowed impurities to 
enter the reaction, he would have to try to combine them 
under very unsual conditions. This might be possible in 
an atomic reaction. 

There must have been an impurity mixed up with the sample 
of Xe, something that would combine with fluorine. He 
probably just thought the xenon to combine ne might have 
used an accelerator, or some atomic device with lots 
of force and power to make them go together. 




A sample of Xe might have beer* placed in an atomic 
accelerat'Or and bombarded by a mas? of electrons forcing 
one electron upon the Xe. Thus, changing it to a 
difference valence like cesium maybe, maJcing it ab?ue 
to combine with fluorine, because xenon, as we know it 
won*t combi'Lne with anything, so he had to change it 
somehow. 



ExaiTOles Score 4 



Since there are many new methods being developed in 
science, he may have found a way to make xenon gain or 
lose ar,\ electron. Possib?Le he could have created a high 
positive magnetic field in an area so small that it would 
pull off only one electron from the xenon, thus causinv 
xenon to be an ion and unstable. 

He took Xe and Pg gas in the ratio of voliane of 1 tc 5, 
and placed it in a nickel cylinder, heated to 400 ^ for 

live hours, under very high pressure so the electrons 
will get loose, quickly-cooled it in a dry ice and alcohol 
bath, and crystals of XeP5 fomed. 

^is reaction could have occurred hy 'Either of 2 processes. 
A real ‘tremendous catalyst could ha've been used or intense 
conditions of heat and pressure during the experiment. 

Since chemists have probably already attempted to combine 
all known elements with Xenon, a catalyst was probably no 
good so he most likely used extreme heat or pressure. 

Since much new equipment, like generators, accelorators, 
atom crackers are being experimented with, probably one 
of these new machines was used and produced a higher cha,rge 
in the stress on the atom than was pi’eviously possible. 

Item 82. The article states that Mendeleef started his 

table by arranging the elements into seven groups. 
Kow might his results have differed if he had 

started by arranging the elements into seventeen 
groups? 



Objective; 



These are two approaches the students meiy take 
in answering this item. The negative view is 
appropriate when the student realizes that with 
17 groups Mendeleef would not. have had the 
periodicity and the vertical grouping. The 
positive objective is justifj.ed If the student; 
realizes that the modem tab].e has 17 groups 
and that had, Mendeleef used tViis arrangement- 
in the first place, it would have been more 
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complicated l)ut he would have had a place for the inert gases 
and would have saved the work it took to derive the existing 
table. No matter which approach is used the responses should 
indicate that the number of groups is detemined by the 
characteristics of elements, not by the desire of the chemist. 



ISxamples Score 0 



The groups would have more elements in them and the table 
would not be as complete. 

There would have been fewer elements in each group and the 
way the grouping was set up would be different,. 

Such an arrangement would not have had any great difference 
except in the groixping of one element under a similar element. 

He would have had too many groups which would have fouled 
up his theory on groupings and experiments with the elements. 



Examples Score 1 



He would have one, two, or three groups containing elements— 
similar to one another. The table v/ould have been much more 
difficult to analyze and to recognise unknown elements. 

His table would not have shown him that the properties of 
elements were periodic functions of their atomic weights. 

‘The table would not have been as orderly and revealing as It is 
is now. 

When he arranged the elements in groups of 7 and brought 
sodium down under lithium, he could see the resen^lance 
between the elements. But if he had brought the elements 
out to seventeen, M and Na would be far apart and you wouldn*t 
have groups according to physical similarities. 

Mendaleef would have had more blank spaces in the 17 
groups. The elements which had similar properties would 
not have been arranged correctly and the atomic weights 
wDiLldnH have been in order. 

He would have come up with a table similar to the one we 
have today which has seventeen groups. He would have had 
to predict more elements mC possibly the table would not 
have had such acceptance as it did due to the greats 
missing parts. 



1 
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Examoles Score 2 



His table would have just been an arrangement of chemicals 
by atomic weights since similar elements would have been 
placed in different groups. He might have attempted to 
arrange them by atomic number. If he had done this he 
probably v^ould have discovered that the 0 group was 
completely missing. 

He probably would have noticed that there were four groups 
in which three elements seemed strangely alike and that 
there were three groups in which only 2 elements seemed 
alike. He probably also would have noticed that this 
same order was repeated in each group of 17. 

The elements could then have been separated into more 
finely graded groups. The similar elements could then 
be closely placed. This would make several groups of 
elements closely related but would allow for better 
placement of newly discovered elements. 

Since the actual grouping of the elements is based on 
the physical and chemical properties of the elements in 
general, the number of initial groups would not matter. 

He would have combined like elements into groups, then 
having noticed the similarity of various groups, he 
would have combined them also. 



Ey.amples Scor^ ^ 



if Mendeleef had arranged his elements in 17 groups, he 
would have had to look for more minute differences between 
the elements. Tliat's why two elements almost exactly 

different groups. Also the atomic 
we^ gh^s ^d activity could be placed wrong with so many 
groups and he wouldn*t have seen the periodicity 3n the 
vertical groupings. ' 

The elements that are now in **a*^ and ’*b’* columns of the 
same group in Table 2 would be in different groups. This 
arrangement would also have left 3 vacant groups for the 
inert gases and similar metals. Tlius, he would have a 
weaker chart when trying to find order in the existing 
elements but would have been a better chart when considering 
the fact he crould have predicted 2 unknown groups. 
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Examples Score 4 



According to the article Mendeleef grouped the elements 
according to their properties. He dldn»t start with a pre- 
conceived number of groups therefore he probably originally 
would have had groupings based on any significant differences 
An characteristics and would have realized his error and 
combined groups using more general characteristics. 

If he had chosen 17 groups he would have seen into the 
problem of where to place an element that had characteristics 
of more than one group. He could liave done this on the basis 
of atomic weights, but since atomic weights says little about 
the relationship between various elements he probably would 
have decided to use another characteristic such as the ratio 
in which the elements combine as a basis for his chart 
classification. Thus probably coming out with 7 groups. 

Item 83 « Mendeleef predicted elements to fill three of the 
gaps in his table, yet he failed to predict 
elements to fill the remaining gaps. Why do you 
think he did not predict elements to fill these gaps? 

Ob;jectivess The student should realize the bases by which 
Mendeleef was able to predict certain elements. 

The ones he predicted were in the middle of knovm 
elements and he could reliably predict them by 
the weights and characteristics of the surrounding 
elements. The ones he didn*t predict were massed 
together in groups near the bottom and he had 
nothing to go by. 



Examples Score 0 



He couldn*t find a suitable element to put into 
the gap. 

He wasn’t certain of the properties they would have. 

The three he predicted are known to exist but their 
atomic weight wasn’t known. The other elements 
hadn’t been discovered yet.. 

He wanted to leave something for other scientists 
to discover. 
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Examples Scor e 1 



Because he didn’t have enough information about the proper- 
ties and weights of the undiscovered elements. 



The unfilled elements are in the high energy phase and 

surrounded by other elements of the same character- 

^ S'o *1»0 3 c 



pe three gaps he did predict were either preceeding or 
following common elements and it was logical that there 
woula be similar common elements, while the other gaps 
vfere not near so common elements. 

I feel he must have died before completing his worics. This 

predicting he only predicted when he 
been in Predicted. He might have 

enough information to predict elements to 

r predicted any more 

would nave only been guessing and not setting 
forth a sound workable theory. ® ^ eouiug 



Examples Score 2 



1 



Since a lot of these gaps were surrounded by unknown 
elements, he couldn’t a^ predict the characteristics 

•f-ho elements. Also, these gaps occurred near 

the end the chart and Mendeleef had no way of Imowing 
how long it would eventually be. i-nowing 

He did not imow at that time that elements, beyond these 
vhat were kno\m to exist, would be d iscovereT. ^However 

^^tween knovm elements could 
be filled if techniques were'developed to Isolate them. 

Because he could not be sure if there was a gap. He used 

slements^^nd proKbly 
a big enough gap between known elements he 

But^?f^ther^®w«Ltr!T^S^ ^^other element here 

4 ^ ^ sap he couldn’t be sure x</hethej 

iv wa& juot inaccurate data or really an element there. 

Exam.ples Score ^ 



The three he p 
he knew well; 



redicted were sandMched between elements 
thus he was well qualified to make a prediction 
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of what mj^t come between. The other gaps are usually gaps 
or two^ three^ or four elements in a row^ which certainly 
leaves much too wide a range of atomic weights, etc., for 
any degree of accuracy. 

He did not see similarities which might lead to the new 
elementso These gaps also appeared under other gaps at 
t^es. Some elements which would be in group I, for instance, 
and be relS-ued to Cs, might not fit characteristics of 
^rxod <•, Contradictions like these could be problems, 

^e re are the zex^ elements which he could not have s?-'^en for 
the above reasons, a,nd perhaps others c 



Menaeieef had an idea of what the three elements he predicted 
would be like because of the positions they held between 
already known elements. So, according to his table he knew 
w^t they would have to be like. 33ut he had places where 
the gaps covered many elements so they didn’t have a place 
between too well known elements so he couldn’t predict them 
^ust by looking at his table. Research would have to be 
done to discover them. 



Examples Score 4 



Mendeleet failed to predict the remaining elements because of 
^e technical limitations in scientific methods of his day. 
Even with all of the technology at the disposal of current 
chemists some elements • have not been isolated. We shoiUd bear 
t"? that his work was far in advance of his day and the 
limitations of his work were due more to technology than to 
his ability. Another reason for his failiire was that he used 
Atomic weight; for had he used atomic numbers he would have 
seen gaps by just counting. 



Item_84. Write a brief history of the development of the 

periodic tables. The article will provide a basis 
for this history, but you should supply events 
which could have occurred in addition to those given. 

Objective; The objective is for the student to make up a 
history of the periodic table. In doing this he 
must fictionalize rather than just to pick out and 

list the facts as they are stated in the reading 
passage. 



Examples Score 0 



Mendelesf began the idea of completing a chart to list the 



elements in relation to one another. His chart has been 

j chemicals that were discovered after his 

death. Many forms were ^de and different layouts of 
chemicals are available. 

Mendeieef discovered the periodic table and there have 
been lots of improvements since he died. 

arranged the elemem&s into seven groups according 
oo thep atomic weights. When he finished he roticed the ^ 
elements were periodic functions of their atomic weights. 

immediately accepted and 

praised the world over as a masterpiece of genius. It 
has been improved on since. ” 



Exang)les Score 1 

periodical table occurred in 18?0 when 
A? thp+ natural order of tte elements. 

several elements were not known 
blank. Since that time most of them 
discovered and filled in. Fairly recently 

weight periodic table, based on atomic rather than 

weight has been devised. 

Somebody realized the organization of the chemical elements 
by characteristic qualities. This led tLm tfpSce 
in some orderly form which led to the making o/a priMtive 

chSactListics realized otter 

the chalt to ils ^Lenffom! continued developing 

- First discoveries of elements. 

■ "“O”" elements by grouping 

them according to similarities. s^ouixog 

I - SSoarati^n^fTh^b®'^'^ discoveries of new elements, 

*+ preparation of the modem periodic table. 

Mendeieef was the first to develop a periodic tahip Wo 
arranged the elements into seven groups but he left°man.v 

EtiglisMen came along and found the 
inert gases anu called them the zero group. They could 
n^e the elements that Dmitri predicted. Current charts 

characteristic!^ weights and familiar 



1 

2 










Examples Score 2 



Dmitri Mendeleef was the first chemist to list in some kind 
of order the elements. til his time scientists were just 
discovering the elements. Mendele.ef, by placing the elements 
in order let us see the relationship between all the elements. 
Of course, during his time all the elements were not known, 
but he knew they would be found so he left room for any new 
ones. Later, Cavendish and Moisson found the properties of 
the inert gases which they put into proper order. Each year 
brings us closer to what we feel might be a complete periodic 
chart, 

Dmitri Mendeleef found elements with similar properties and 
arranged them into groups. By noting consistencies combined 
with further study, he completed a table of known elements. 

He also predicted elements and left spaces for others, using 
known consistencies as a guide. 

Further research by later scientists found the predicted 
elements and those which filled the empty spaces. A few 
changes were made in the table arranging elements to atomic 
order instead of weights*. Energy levels and other known 
facts were used to improve the table. A chart of electron 
configuration is now used. 

A man named Mendeleef became interested in the atoms of all 
the elements. He decided there must be some relationship 
between all these elements. He began by experimenting until 
he had placed them in a different order according to weight 
and he lined them up in groups of similarly looking and 
acting elements and found a remarkable pattejm. Through the 
years he and later scientists foxmd out a good deal about new 
properties and new elements, and Mendeleef *s chart had to 
change again to fit all the new elements and the ones they 
made, and because they were using atomic numbers for a base 
now, and not atomic weights anymore. 



Examples Score 3 

Through history, as man began naming elements, he discovered 
that some resembled others in certain ways. Mendeleef recog- 
nized this in a more profound way, and organized the known 
elements into groups according to their similarities and atomic 
weights. Surprisingly enough of the relationship between the 
weights and the group stinicture held, even with the discovery 
of new elements and so the first periodic table evolved. The 
table has been continually used as a ba^Jis, with other facts 
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&dd8d on as research and discoveries 
protons, neutrons, electrons, atomic 



developed-such as 
weights, and orbitals. 



Examples Score ^ 



1800 - 
1810 - 
1820 - 
1840 - 

i860 - 
1900 - 
1920 - 
1945 - 

X950 - 

i960 - 



Crude knowledge 
Mendeleef bom. 

Work progressed slowly in chemical fields 

Work on periodic table by Mendeleef 
Mendeleef* s work taken up 

As technology advances, table is filled in 
Atomic bomb helps fill in chart 
el^lnt?^ introduces new work on chemicals and 

Synthetic production of new elements 
Somio »feights and numbers of the 

he attempted to fill in the» corrected, 

predictions have proved correcf^ table-his 

later sevfntein 

through^the y2rsrLd°the®ctart*L'now\a^ discovered 
Of carbon instead of oxygen, ‘'thLe^rtKirchangel'®''" 



Examples Sonyp 4 



S5?S.^5SK‘SMSv£"n 

mi the blank 8potr!n Mrp|Jfodfc®&^" 



dxscovery it is possible that chemists could believe still 
other eluents had to be found* When atomic numbers were 
round ®id related to the previous tables, they probably 
noticed that the atomic numbers were closely related but 
that’s where the atomic weights showed no possib7.e gaps 
between elements the atomic numbers did. Then cneiaists 
probably tried to find these elements suggested by the 
missing atoMc niMbers. Also, with discover^' of a few new 
elements wh^ch fit into the atomic number gaps and not the 
atomic weight gaps, it became necessary to change the 
arrangement of elements to the order of atomic numbers. 



«n the beginning, people knew that there were things called 
eluents, and suspected maybe that they combined with each 
other, but they Just went about with their chemistiry in a 
hapn^ard manner. Then, along comes this Russian guy who 
decides to make cn orderly list of all these elements all 
place. So, he m^es a list of elements according 
to their atomic weight and. What ho! it turns out to be 
even more orderly than he suspected. At first people say. 

So what? but then eventually they are convinced, and some 
people become fascinated with the idea that elements have 
order. After a while, they come up with this "periodic 
table which becomes accepted all over the world. 

One day these scientists were heating helium and somehow 
discovered that the little electrons Jump into higher energy 
levels and what’s more, they’ve got orbitals instead of 
shells. This calls for rewriting of the periodic table, so 

come up with the "electron 
elements," based on new discoveries and 
this chart will do very well until someone discovers some- 
thing else which will change it. 

First classification of elements which con 5 >ose the earth into 
four basic things; air, fire, water, and earth, primitive 
p^ples are extending far into civilized scientific beliefs. 
-Medieval times when the alchemists searched for the magic 
rormula which would turn anything into gold. 

-Discovery of these simple basic el©nents, gases of hydrogen 
and oxygen, advancement of methods and theory as pure science. 
-More elements found and identified, tentative theories of 
classification 

-Mendeleef comes along and revolutionizes classification of 
fje^ents with periodic grouping by atomic weight, 
-^edictions of unfilled and more gaps filled in due to 
advanced techniques in research, whole zero group found 
-Radium and radioactivity found by Curies 
-Synthetic production of elements by atomic bombardment 
-Further development in atomic research during and after 
World War II 
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on light weight compounds, study 

metals ^ detail, study of fuels and 

rockets, new characteristics and 

Sn?f ta possibility of new 

Item^. Suppose that you were the first chemist to 

Q'Hother planet. What steps wo^’.ld you 
take in constructing a periodic tA^ie of the 
elements found on that planet? 

Objective; The student should recognize the steps taken in 

current periodic tables and specify 
how these steps would be used in organizing a 
new cable. In his answer a student say also 
postulate similarities and differences in the 
elements of the earth and naw plants and 
formulate plans for testing the assumptions. 

Examples Score 0 

?? eiefflsnts in the three different 

oms (solids, liquid and gas) and analyze them. 

st"actup6^anrt°tL«^l^^^§ I could about their atomic 
® '•*-'^cture and then follow Mendeleef*s cue, 

suppose I am the first chemist to visit a new 

i ^l^at by then I would know how to 

start a new periodic chart of a bunch of unknown facts. 

differ?^^^^ against ours] eliminate and add those that 



Examples Score l 

Find physical and chemical similarities, find atomic weights 

It ciuirivefL Is^tosteaf ofT°’^''^® 

properties of each element 
lound, and arrange them according to similar comhininff 
properties and progressive weights. combining 

I would try to fit the elements there to the periodic table 



I 

I 

I 

I 

8 

I 



I 

I 

I 

I 

I 

I 

I 

I 

I 

I 

I 

8 



ERIC 






■ re ra g>p g 









we have here, for there is no reason to expect they would te 
radically different . 

Spectroscopic analysis of the materials foimd on the planet 
vjould be the earliest method of identifying them. 



Exang)les Score 2 



I would take samples of everything I could find Into my lab. 
Then I’d perform electrolysis on my san 5 >les and turn al 2 . 
compounds into their respective elements. Then, I’d take 
1 cc of each element I had and weigh it. Prom these weights 
I’d determine which would be the heaviest, lightest, etc. I’d 
assign the lightest one a number of 1 and use that as a basis 
of assigning weights. 

Experimentation is the first step. I would try to find the 
basic elements in the air and surroundings. I would try to 
compare their properties with the known elements. After 
finding out what I thought to be fairly accurate amount of 
properties of many elements, I would place them on the chart 
according to their atomic number. I would leave vacant any 
area which I was not stire of for further findings. 

First, I would set up a base element, one that would be use^L 
to determine the weight and number for the rest. All with 
similar characteristics would be placed in one g 3 x>up. Such 
things as if they tend to become negative or positive ions 
would be observed. After all information possible was 
received, then the similar elements would be placed in a 
group inanning vertical. Energy increase potential would be 
on the horizontal line 5 further to the right, the higher the 
energy. 

List the elements in some order of sequences according to 
similar properties. A comparison to known earth metals might 
be useful. Readiness to combine, weight, physical properties 
would all be characteristics which would influence their 
placement on a table. There elements appeared unrelated, gaps 
could be left In hope that later elements could be added. 



Exaas>les Score 3 



-Make a list of known elements 
-Test them for similarities in their behavior 
-Begin placing them in groups according to the minlber of 
general and recurring characteristics 
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-Disco\^er the pattern of the electi^on, proton and neutron 
distribution 

-Once j.n groups, they must be arranged in o?,’der of 
increasing energy 

-Space for as yet tandiscovered elements must not be 
omitted because some elements vdll be difficult to find. 

If the filements were vastly different from these found 
on earth, I wouV: first try to determine the new elements* 
atomic structuits. Tnis is done by attempting to combine 
them with elements of known structure. I would record 
all the s’esults and compile the characteristics of the 
eLements,, Also, the atomic weight could be determined 
through a comparison with carbon. 



After all fa its have been determined about the elements, 
I would attempt to find the order of the chart 
placing the elements in order (by atomic rMiijer) and 
putting them in columns by characteristics. 



I would first gather all the elements tha^ t could. 1 
would then choose one and react all othern wit.i it 
grouping them according to the similaritit 3 of reaction. 

I would then proceed through checking properties, 
weights, etc., to group them. Extensive tests with other 
elements would be necessary to assure any accuracy becaur^e 
perhaps most of them wouidn*t even react with the first 
one X chose. I would have to decide on a basis for my 
beginning separation and it would be the reactions. Later 
I would go on to check physical properties, etc., and 
make finer distinctions. 



Examples Score 4 



I were the first chemist on an 
uninhabited planet is to check around and get some samples 
of ail the elements I can find. I»d identify the ones 

isolate the ones I 

didn t know and try to classify them on standards of the 
similar earth elements. After determining general charac- 

groups of the various different types 
of elements, X would make tables of their atomic weight 
^d numbers and decide which would be most effective as a 
basis of order. I would have to leave a few spaces for 
the ones 1 couldn’t find, and if I have really found the 
pattern of occurring, then my table would fill out just 
like Mendeleef’s eventually did. 



-Get sauries of all available elements 



-By experiments find out: 
combining ability 

electricity (metals, etc.) 
normal phirsical states ' 

atomic 'itructure 
energy levels 

weight arid going by diaeovered proper- 
ties, separate thsa into groups 
-Determine periodicity 

is earth basis put them in order 
groups should line 

veri.i.caiay if it is right 

First o£ all I would have to start my plans before leaving 

available astronomical^ 
^ order to determine what types of 
^ ®xpect. Also since many scientists feel 

matter has a common source I would devise means for 
detecting^elements for which there are gaps in our table 

thf hi^er than our table. After arriving on 

^ would begin by systematically identifying the 
j^emenbs found on earth, most or all should be identified. 
Then, I would try to identify elements 104, 105, 106, etc. 



Evaluation Sample Responses 

Itt^^, He is a professor of Chemistry at an Ivy League 
University. j 6uc 



Examples Scor e 0 



Qualified. He should Icnow his chemistry. 



Just because he’s a professor of chemistry 
doesn’t mean he’s studied the periodic table. ^ 



No effect. He couM have studied the chart anywhere. 



Examples Score 1 



?? ® professor he would have a bachgroimd 

^emistry^^^^^'^ table since it Is necessary for the s^dy of 



Not qualified. 



No effect. He probably has studied the periodic table but 
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he may not have studied the history of chemistry enough to 

write & out it. He might have specialized in oil and its 
properties. 



Exm^les Score 2 



Qualified. This man is not only a professor at a univer- 
^ty but at a highly respected (Ivy League) university « 

that he must have a good background in reseax*ch 
and thpefore he would know where to find the information 
to write on the periodic table. 

Not qualified. 

No effect. As a professor at a good university he probably 

chemistry and the research experience 
^ find information to write an article, but cm he write? 
There is no guarantee he can get across what he wants to. 

Kern 87 ., He is m)t a member of the American Chemical Society. 

Examples Score 0 
Qualified. He is a philosopher. 

Not qualified. He is not a good chemist then. 

No effect. A lot of authors are not members of the A.C.S, 



Exai^les Score 1 

Qualified. Because to be a member of A.C.5. you have to 
be a CaiCffixcai researcher and this person was an historian. 

Not qualified. Because the American Chemical Society is 

Xeading American chemists 

article is about a Russian 

Russian^C | too and is a member of the 



Examples Score 2 



Qualified. 



SERLC 

m 
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I 

I 

I 

II 
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I 



I 



Not qi 2 ^ 1 ifi@d. iTae early parts of the article deal with 
history which asiyone could read from a hook, out the last 
part des^ls with laodem things* You ti^uld have to know a lot 
of chemistry to get all the facts right in a short article 
and since the new chart is by an American I assume the author 
is American and if he is a qualified chemist he would be a 
aeiiRber of A.C„S. 

No effect. The persons qualifications should be judged by 
the accuracy of his writing not by his club meraberships. 

Maybe he is a smart college student but doesn*t have the 
degrees to get into the A«C,S.^ besides for all I know the 
A.C.S. may be a group of crackpots. 

Item 88. He discovered the element Am. 



^ples Score 0 



Qualified. This shows he knows what he is doing. 



Not qualified. He would not know history. 
No effect. Maybe it was an accident. 



Examples Score 1 



Qualified. In order to know he had found a new chemical he 
would have to know a lot about how the elements fit together 
and liow the chart was made. 



Not qualified* Because the author would have to know about 
history of chemistry and if he discovered Am this means he 
is a researcher and wouldn't be Interested in history. 

No effect. A lot of discoveries have been made by accident 
by people who don't know what they have found, but have 
been told what it was by someone else. 



Examples Score 2 

Qualified. He must have studied a lot of chemistry in order 
to find a hew element. Since Am was not on Mendeleef's chart, 
he probably bad started by a careful study of the chart and 
found out what characteristics the element must have. He 
would have had to study the later charts too, so he would have 
to Imow where it fit, so after all this study he would have 
the information. 



I 

I 










Not qualified. 



No effect. Becauce this doesn*t tell if he knows about the 
history and all of the changes. He could have found this 
information by looking in some books. Discovering an 
element doesn*t say he looked in history books. Besides 
he must be able to write in simple English for high scliool 
kids and a lot of scientists can only write with a lot of 
X*s and =*s. 

Item 89 « He recently wrote a high school chemistry book. 



Examples Score 0 

Qualified. A high school chemistry book contains the 
periodic tables. 



Not qualified. A high school chemistry book isn’t 
written on a high enough level. 

No efiect. A high school chemistry book may or may 

not contain a chapter about the periodic 
table. 



Examples Score 1 

Qualified. The very fact that high school cheiaistry hooks 
contained section on the periodic table means 
he is able to write about them. 

No effect. High school chemistry books liave more than 
one author; maybe this author didn’t write 
the section on periodic tables. 



Qualified. 



Our chemistry book was written by a Ph.D. at 
Harvard and contains a whole chapter on the 
periodic table. I guess for a book to be 
accepted the author must be qualified. If all 
h.i.gh school chemistry books have a section 

tables the author must be qualified 
to write on them. 



Not qualified. 



No effect. H^ might ha/e written the book but maybe it 
wiis so bad that he couldn’t get it published. 












I 

I 
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And even if it v/ere published that doesn’t say the author 
is qualified. 

Item 90. He constructed a modem Periodic Table,, 

Exam ples Score 0 

Qualified. Then he must know about the old onef^. 

Not qualified. Because he didn’t believe the old ones were 
any good. 

No effect. Maybe it was a table of wars. 

Examples Score 1 



o 



Qualified. Because he would have studied the old ones t 
see where they were right or wrong. 

Not qualified. Because he would think his was a lot better 
and would find fault with all the old ones to 
make his look good. 

No effect. Because it would have no effect if he was using 
a different way of grouping the elements. 



Qualified. 



Examples Score 2 



In order to construct a modem chart he would 
have to know a lot about chemistry and how 
elements are alike and different. His history 
would be one which would show what different 
people used to classify elements and how their 
work provided for the clues to undisco'/sred 
elements. 

Not qualified. 

No effect. Maybe he is trying to make a table people, without 
much chemistry can understand — like me, for 
example. In this case he would take a complicated 
table, like table 2, and maJce it more simple, 
but wouldn’t ha\e to study all of the old ones. 

Item 91. He is a teacher of high school chemistry and does 
not use a Periodic Table in Ms classes. 









36 



Exampleg Score 0 



Qualiried. Th© periodic table is too coBiplicated for high 
school students; he is wise. 

Not qualified. If he doesn’t use the table, how is he 
qualified to write about it? 

No effect. Just because he doesn’t use it doesn’t mean 
he doesn’t know about it. 



Examples Score 1 



Qualified. A teacher of high school chemistry must have a 
wOiiege degree and therefore would know where to find the 
information to write about the periodic table— if he didn’t 
already know about it. 



Since the periodic table is the basis of 
using it indicates that either he doesn’t 
understand io or he doesn’t realise its importance. 

using the periodic table is just his 
teaching chemistry; maybe he thinks it’s too hard 
for nigh school stuients. 



Examples Score 2 



to be^tPftPhir^ 9' degree in Chemistrj 

In ^act that he doesn’t use the table 

doesn’t know about it; mayhe 
teaching method. With his background in 

write^about^it^'^^^ about the subject and 

about something you would have to 

couM whenever you 

could. This teacher obviously doesn’t reallv belipva in 

something which is very close to tte basis of all cSmi^tin 
so how could he write about it. chemistrj 

statement could be interpreted two ways. 

he is school chemistry teachers. If 

? ®°?^ teacher, we can assume that he has a reason 
hf the tables if he is a poor ?eacher ml^f 

ne doesn't know it enough himself to teach it. Even if 




he were a good teacher, he still might not he qualified to 
write.. 

Item 92. He has a collegte degree in Russian History. 



Examples Score 0 



Qualified. Mendeleef was a Russian. 

Not qualified. History is not related to science. 

No effect. It doesn*t nay if he did or didn’t study 
Mendeleef. 

Exagg>les Score 1 



Qualified. Since the first table was by a Russian scientist, 
he would have known about him in history. 

Nox qualified. The study of Russian history wouldn’t say 
anything about modem tables constructed in other countries. 

No effect. This only says he probably studied a lot and 
read some about Mendeleef. If he was interested he could 
have written the article. 



Examples Score 2 



Qualified. In order to ^et a college uegree you have to know 
your subject and be able towrite well. Mendeleef was a 
famous Russian, so ht would have read about him. He could 
easily read about ?r'^dem tables and write a good history. 

Not qualified. Because to write a good summary on something 
you have to know a lot of facts. In trying to figure out 
the modem tables and why they were changed, he would get 
confiised and write things that may not be true. In other 
words he could copy from hisjtory books, but could not 
figure out present day chemistry without a lot of study and 
a history major doesn’t study much chemistry. 

No effect. The fact that he studied Russian History doesn’t 
say if he studied Mendeleef ’s chart or any others. The 
article says Mendeleef was a philosopher and history more 
ph-Jlosophj’ than science. So he would have heard of 
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Mencleleaf, "but luay not have been interested in tracing his 
won: to today or he may have if he was interested. 

It~>m 93 » He wrote the article for an assignment in a 
college English course. 



Examples Score 0 



Qualified. All you have to do is look up the facts. 

Not qualified. A student isn’t qualified because he 
doesn’t have the background. 

No effect. It doesn’t matter if the article was written 
as an assignment. 



Examples Score 1 



Qualified. A college student has the ability to write 
well and knows how to look up infopnation. 

Not qualified. Most college students use encyclopedias 
for reference and this wouldn’t be an adequate background 
to write on the periodic table. 

No effect. Maybe he was a graduate chemistry student 
taking English for kicks. 



Examples Score 2 



Qualified. To get into college you have to be smart and 
know many things such ais how to write so people can under- 
stand you. Also, you have to know how to use the library. 
A student would be qualified to write such a poor article 
as we read. 



Not qualified. A student writing for an English class 
would be more interested in correct spelling and grammar 
than ^ what he is writing about. He might have even 
copied all of the facts from the encyclopedia. 



reason why a student could not 
write the article. On the other hand, he 
could Imve copied the article from a book. He could be a 
Chemistry student specializing in the table. 




I 

I 

» 

I 

I 
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Item 04. He was educated in England, 

Examples Score 0 . 

Qualified. The English schools are the best. 

Not qualified. English schools are not good in science. 




excited?' any difference where he was 



BMmples Score 1 

Because the article says that two Englishmen 

thpS sroup. He would have studied about 

them and learned about the old charts. <-uu-i-bu aooax; 

Not qualified. 

if**®*"? 2"? educated doesn't make any dif- 
ference, it is wnat is learned that counts. 



Examples Score 2 



Qualified. 

Not qualified. 

^ advanced technology and has 

he is ® science education 

bl something else he wouldn*t 

Sflct^britsllf r ^ ^ educated in aigland has no 

It^_55* H® believes that only about half of the elemf>nts 
have been discovered. 



Examples Score 0 

Qualified. He may be right., 

Not qualified. He is some sort of a nut. 
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No effect. He can believe what he wants to. 



Qualified. This shows that he knows a lot about the 
nobody and found gaps 



Because many people thinfe other planets hav( 
soientisis! ^ ®®“ a*"® not usually 



No effect. Because this doesn»t say anything about his 
knowledge of the history of Chemistry. 



Examples Score P 



chart^tn^the’^Ldina ®^® filled in thf 

snSL for P passage means that he has discovered 

spaces I or a lot of new elements to eo on the enri Tr» 

£ siiss » j 

understand much chemistry becau8e\is^"new"'"plB*^”p* 
probably ions or compoSs? "®" elements are 

to do^with old^charts*^^ new elements has nothing 

with the new charts so today work only 

Old ones unless collecting thfm wal h“fcf of southing. 



Glaciers 





Item_^l. Suppose that a glacier is advancing toward a 
town and that you have been asked to estimate 
will take for it to reach the town. 
Briefly describe the steps you would take to 
make this estimate. 



Objective; The subject must recognize that this is a rate- 
tme probl^ which will require physical measures 
plus consideration of other factors which would 
. ogical^y be involved. Such factors as seasonal 
chOTges, mass, terrain configuration, and their 
efxects must be applied to the prediction. 



Sxamples Score 0 



X would estimate the speed, 
much time there was til it 



then be able to determine how 
reached the town. 



I would keep accurate check on the amount of 
the glacier, temperature and air moisture. 



movement 



of 



Find out how fast it*s moving and divide. 



Estimate the rate of accumulation and melting and conqpare 



Xbcamples Score i 



rate of speed at which the cla^'ler is 

thi giaoier to 

and conditions tteC^feot thrSacie??^^^"® ter.peratures 

calculate the tlae to reach the town. and 

X would place a line of poles across th#» . 

to chart the flow of the different t>ftrt«“ne _? 
each day, and total movement in relation to tho 
out of the bounds of thrglL“r! 
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Should 

Si»“lh?Si r1® St tKSI^JfX'K JiS“'* 

take the glacier to arrive there. 

rprn^ J-p**^'*^*^ the average temperature, then a 
to Iwt veSl”’?^'^?^ the glacier’harSoved 



Sxampies Score 2 

ffest^tf fts^weteht® y°« «°«W l«v 

summer months. ® during the 

^ftiien fwojLf take^f se?ies®of*“^®'® 
averages in advancement. D^to«^the^tto?*a?t® 

I would check the elaSer time after and before, 

cracks as other thin«s tLfmTp^i°^® 

Also, I would watch tte*vreathef*^and the °l ^s«ger. 

activity. weather and the amount of avalanche 

get here,^Sd then*^I*would see*what"*if?”d t°°*^ to 

covered and theHee wtet k?nd country it had 

cover. Make afavlra^e of its sLeH^jy to 

see how long it would takL^ ^ ^ ^ y roughly 

is every year, i would thl * !?® snowfall 

much is tLen away! I ?oufd Lp?® see how 

the time to reach ihe torn. ^ estimate its speed and 



Examples Soorc* ^ 

Ii a glacier ya'? advancing toward a town. I would* 

1. Determine the rate and amount of kowfall in tv,, 
area of the glacier and approximate the run off® 
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3. Take the amount of miles to the town and divide. 

4. Take into account the terrain, slopes, etc., as 
obstacles whj.ch would slow down or speed up its 
advance. 

I would find out the average temperature of the town, 
average snowfall, the angle of the slope of the land, and 
the highest and lowest temperatures and the amount of 
rainfall. Then, I would calculate the amount of snow 
that would accumulate on the glacier, the run-off and the 
rate of the glacier. From this I would determine the 
final rate of the glacier and the distance from glacier 
to town, and finally calculate the time it would take to 
get there. 

The first thing would be to get data on how much snow has 
fallen each year for the last several years and this year * s 
prediction. Then, by finding out how much headway the 
glacier makes in winter and how far it retreats in summer, 
you can find its forward movement for several years. If 
you know the distance to the town, and consider things like 
sudden changes in weather and the different type of land, 
the estimate should be fairly dependable. 



Examples Score 4 



1. Obtain weather information from the weather bureau 
on conditions in the area and future conditions. 

2. Determine the distance the glacier has already 
covered and then figure the average movement for 

a week, and mark the distance it moves for a given 
time period, according to the weather ^ 

3. Make a study of the topography and probable path 

of the glacier, and factors which might alter its 
course. 

4. Approximate what effect change of season could have 
if it were to take a long time to get there, a late 
winter freeze, or an early spring thaw, and check on 
past records of the glacier^ because a sudden thaw 
could increase the rate by a huge amount and disprove 
your estimate completely. 

First, I would consider the general climate. It would have 
to be pr«5tty cold and have a lot of snow, or a glacier would 
never be able to come that close. But it might have hot 
summers and it would melt a lot. The surface of the ground 
would have an effect, too. If it were mountainous the 
glacier would have trouble going up moxzntains and woiud go 
down pretty fast. If it were a slow incline, up or down. 




it would have less effect on the movement of the glacier 
according to the seasons. Such things as forests or cliffs 
m ight impede its travel ^ too. If it were little and going 
up hill it wouldn*t go nearly as fast as a big one going 
down hill. So a after I had studied all this> I would calcu- 
late its present rate of movement, predict a reasonable future 
rate, and divide into the measured distance to the tovm. 

Item 82 . A scientist believes that advancing glaciers slide 
on a thin layer of water which lies between the 
bottom of the glacier and the earth. Outline a 
plan to test whether his belief is true or false. 

Objectives ; The objective of this item is to test the 

students ability to comprehend the difficulties 
involved in the most obvious solution of direct 
observation and to suggest a workable alternative. 
These alternatives may be in the form of special 
procedures or miniaturization of the problem. 



Examples Score 0 



A blockade could be set up to block the ice flow and any 
water build-up could be observed. 

I. Find two glaciers: 

a. One glacier stable 

b. One glacier moving 
II. Examine both glaciers; 

a. The stable glacier should not have a thin layer 
of water underneath. 

b. If the moving glacier does have a thin layer of 
water, make other comparisons of moving and stable 
glaciers. 

Well, as the glacier moves forward it also decreases, but 
at a slower rate. This would always leave some runout in front 
of it, or a thin layer of water to move over, but doesn*t 
mean it moves over it. 

False, because the water would run off from the glacier. 
Although if there was a constant drainage of melted water to 
the bottom of the glacier it might be plausible. 

Examples Score 1 



Drill a core into the glacier and examine the portion where 
the ice meets the rocke 
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^ though the ice and study the ^ ore samples • 
determine the temperature undei* the glacier 
crevices, etc. If the temperature was below 
say 30 degrees it*s unlikely there *s water at the bottom. 

Detemine the path of the glacier. On the path, dig a 
station reinforced with a tiny hole in the surface. When 
the glacier Passes over, you will see if water leaks in! 

If it does, that assumption is true. 

If the Slacier is not too thick, then pumps and drills could 
Su? flfierjuitil the’bottom was 

?h» action and if water is obtained from 

the statement is true. I definiteli? believe 
on^a wSm^ly* because that's the way a block ^ ice slides 



Examples Score 2 



1 . Place an ice cube on a slight hill. 

S^ditiowsr^'' miniature and establish- similar 
3» Watch action of ice cube.-, 

model of a glacier, having the same 
tSs m«y ttoes. Observing. Do 

A glacier is the same as a giant ice cube. You could n«p 

jepj^esent the glacier. You could "see 
whether the statement was true for the ice cube and if 
it was true then it could probably be true for the glacier. 

I would somehow build two man-made glaciers and th^n 

put one with a thin layer of water fvefthl Srth ^d n»f 
the other one on plain ground. e&rth and put 

same conditions as 

the ftxacier: air moisture, temperature, and snow fall 

S': 

S: o^^ oTtKS^ a? and 
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Under controlled freezing conditions? 

Set up rock”- sandy run 

Start big ice hunk down 

Note moisture and surface changes 

I know ice will slide, but I also know that the bottom 
of ice surface might melt if it came in contact with a 
warmer surface than itself. 



test in the lab and have the entire glacier 
ylsiole at all times. This test would give me the necessary 
informat-ton as to whether glaciers slide on a thin layer of 
water. My test would be very real, because I would let a 

glacier advance under the same conditions it advances at 
present. 



Lab Test: 

1. Construct artificial "terrain" with glacier. 

2. Lower temperature substantially. 

3® Ai.j.ow glacier to move down terrain and measure ■’^ate of 
descent. 

4. Reconstruct terrain and glacier exactly. 

5o R&is© teiaporfitur© to non&s.! <&nd tini6 d^scGnt* 

fu temperature allows glacier to move readily 

then the increased timcunt of water under it allowed it 
to move faster. xo 



^ large cube of ice below freezing temperature 
Stacked on top of it and push it back 
and forth on a rubber carpet. There would be a powder water 

c‘',rpet. If there was a. liquid, the powder water 
would smear,, if not it would not smear. ^ water 

It^2, The land over which a glacier has passed suffers 

considerable damage. Briefly outline why ^Lilrs 

cause damage and describe the kind of d^age they 
might cause. i,ney 

The object j,ve of this item is to present a 

^ subjects may build upon 

^p^ications in the article. The complete answer 
gpes beyond the obvious solution Presented 

to mass. 

t£ plant and animal 



Examples Score 0 



tremendous weight. 






They freeze everything. 

They kill the people and animals. 

- V . 



Everything in the path of the glucier 
becauGe of the weight of the glacier, 
crushes everything^ all the trees and 



is tom dovm or smashed 
The weight just 
anything in its path. 



^^^le£ Jcore 1 



^e weight of the glacier can change the contours of the 

flattening hills and forests, filling 
in crevices and forming lakes. Also, a glacier carries ^ 
material along with it which it deposits along the way. 

would freeze the grass and 

min^the^L?? islide. Also, they would 

ruin the soil so that no other vegetation would grow there. 



Examples Score 2 



Ice is hard and it contains small or large particles of 

SI ''ill "sanfpa|“« griinf 

and wear it. Loose material will be pushed along or 

®f ice hardness, density, etc D^ag© 

and trenches S loose 

eourra+erlai^?pf+\^^^^ removed, and miscellan^ 

eous material left behind when glacier recedes. 

pie glacips pick up rocks and debris while moving th© 

fSIS.ns.'jS'Stj'SS’lbSSJS “ “■ 

Glaciers are large, heat'y moving pieces of ice For* fh-to 
reason, they can cut trelehes iS ground, ruircronf 
avfay soil, and even move large bo-5lders Wh« the^ffiacill^ 

formation of lakes, riverafSl®"^® 

I. Cause 

A. Large moving mass 

B. Extreme cold 

TT Water demage due to run-off 

XX • £iX T0CT/8 

A. General leveling of objects 

B. Death of plant life 

C. Death of animal life 
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Examples Score 3 



Glaciers do not go around objects, they go over them. Say, 
for example, a glacier overtook a small forest. The glacier 
would freeze the trees, then as it moves, carry them with it. 
The trees, rocks, etc., are dragged along the ground, tearing 
large holes in the surfaces. 

Life in a glacier does not exist. After hundreds of years 
the ground is useless. River beds are often the result of 
glacier growth and shrinkage. Even after the glacier does 
receed, it will take hundreds of years to recondition the 
entire territory. 

Glaciers weigh a considerable amount. Moving so slowly over 
land, it could cause ruin to plants and top soil. The run- 
off could flood a valley and kill animals. A glacier might 
go to a city or town and destroy millions of dollars worth of 
property and homes. It would ta::e the land years to grow 
and mature enough to be able to cultivate or for grazing land, 
or just for plain forest area. 

I. Glacier damage: Depending on what type of ground it 

moved over. 

A. Whether -there were house and structures. 

B. If the terrain were smooth, gashes like the Grand 
Canyon woiid appear and mountain ranges would build 
up where the glaciers stopped. (Example) 



Examples Score 4 



/RESIDUE 



0BFOHE 

Gi-AC)ER 



GLkCi£f{ 







Glaciers eliminate all life, both during and after passage 
The climate ooiidltions associated with glacier formation 
make it vir-{:iially jmpossible for plant and animal ljf» to 
survive pr;io? to a.L'^cier passage. The bulk and tremondcus 
weight of wito gl removes the top-soil and humus, making 

it inipossiule rcr the ground to sustain vegetation. ^ 



The terrain itself is changed. Fusion is a constant problem 
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and much of the ground after jsage is unmanageable and 
untillable due to debris. Af . ,r glacier passage, the 
weather conditions are usually still bad and floods' as 
well as long periods of cold weather keep the territory 
from rebuilding rapidly. 

When a glacial age occurs with glacier passage imminent, 
the climatic conditions prevent normal vegetation growth 
with an accompanying decrease in animal life due to 
starvation and migration. Erosion is a problem, both 
before and after a glacier due to this destruction of 
vegetation. The glacier itself exerts such a large force 
as it moves that valuable topsoils are scraped away, 
leaving nothing but unfertile subsoils. It takes nature 
hundreds of years to replace what is lost and sometimes 
this is never accomplished. 

They freeze plants and roots. When they move, they dig 
up entire land surfaces. The water content is over-abundant 
and exceeds the amount the land can take in. Human beings 
and animals are unable to survive in the cold. When they 
melt, the runoff floods valleys and rivers, destroying more 
land and homes. The land may be frozen for many years, 
unable to reproduce growth. 

Item 84 . Briefly describe a method by which you could 

determine if the vertical thickness of a glacier 
is increasing or decreasing, in your method, 
indicate measurements you would take and how 
would you use them: Remember that glaciers move! 

Objectiv e: The student must recognize that the measurement 

of the vertical growth of glaciers involves more 
than drilling hries and measuring thickness. The 
complete ansvrer involves not only mass movement 
but also requires a valid method of establishing 
a base point for measurement and keeping trs,ck 
of the base point, compensating for terrain 
configuration, the establishment of a logical 
plan for continuous measurement checks and the 
use of particular devices such as siesmographs. 



Examples Score 0 

Drill a hole every year 

Look for cracks and measure their depths 
See how far it moves 
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Examples Score 1 



Take measurements of the thickness of a small amount of the 
glacier at different intervals and compare them after a 
certain period of time. 

I would take a reading on its altitude hy using an altimeter. 
I would take several of these at various times. I would then 
calculate the average height over a given time. 

Just stick a pole down into the glacier. Mark the pole in 
feet and inches aiid as the thickness increases, Just look 
on your pole to see how high it has risen. 



Pick a spot where you knew the point where the earth was. 
Line up a spot so you could stay on that point no matter 
where the surface goes. Just keep measuring and recording. 
You would measure the points from the surface to the earth. 



measure the distance the top of the giacier is from the 

mark. At pre-determined interval?; come hack and take auiother 
measurement . 

1. Buy a 4,000 foot drill 

2. Drill hole in glacier 

Put special marker in hole 
4. Check readings 



Examples Score 2 




Mark an area of ground Just above 




(Continued on Next Page) 
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Examples Score 3 
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I would bore through the ice with an apparatus similar to 
those used to take samples of the ocean bottom, I would 
then insert a pole in the ice down to the level of the 
ground. This would have to be an extremely strong pole 
capable of withstancJing g:eat pressures and the shifting of 
ice. I would have the pole marked as to feet and inches 
and would also do this in several other places to make 
sure. The pole would move along with the glacier and 
measizre any build-up. 

I would calculate the height of the glacier by using 
trigonometry. Calculate rate of incline and the angle 
of inclination from the base of the glacier (using an 
altimeter to measure the air pressure) to the level of 
sea level and knowing the distance above sea level at 
the base of the glacier, could figure the height of the 
highest point, subtracting the height above sea level. I 
could do it periodically and the information collected the 
first time I could figure out if the glacier was increasing 
or decreasing, always considering the varying distances 
from sea level. 



I 

I 

I 

I 

I 



By placing a laboratory on the glacier* s surface that 
would move with it, it would be possible to work better. 
From there the scientist could drill until he reaches 
bottom and take a section through the glacier to be 
brought up and measured. This could be done at intervals. 



Examples Score 4 



Assuming that all the necessary equipment was available, 
first mark the spots for measurement. Set in place marker 
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poles of some type. Use a drilling arrangnent similar to 
that used by oil field workers. Set up observation stations 
to keep track of the marker poles as they move with the 
glacier. Take readings in the same general locations as the 
first readings to determine whether intervening snow falls 
have actually packed down enough to increase glacier thick- 
ness. 

Use a seismograph to plot out the terrain features under the 
glacier, Mark spots for drilling or echo soundings. Repeat 
these measurements over a period of years to see if conditions 
have permitted the ice to increase o’j^ decrease. The places 
for measurement should be carefully marked on a map so that 
measuring parties can return to the ssmie spots every year. 

Select an observation point and relate it to some immoveable 
object. Take corings of the glacier to measure its thickhess 
at that point. Wait a pre-determined length of time and 
take another coring and measurement. This new point will not 
be the same as the first point on the glacier since the 
glacier has moved^ but will be the same point as related to 
the fixed object. Doing this at regular intervals could 
calculate the fluctuations in thickness. 

Item 85 » Suppose you knew that an advancing glacier would 
reach a town in 12 months. Outline a plan which 
could be followed to prevent the glacier from 
reaching the town. 

Objectives ; The objectives of this item are two-fold. First, 
me subject must devise a logical method for stopping 
the glacier and secondly, that most procedures would 
result in much ice of water to contend with and a 
method must be developed to dispose of it. Ample 
considera:tion must be given to the enormous mass of 
a glacier. 



Examples Score 0 



Move the town 
Sell ie cubes 



Haul it away on a truck 
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Examples Score 1 



By increasing the melting rate of the snow (by salting 
the ice or treating it chemically) and then diverting 
the water flow away from the town, the glacier would 
melt. 

First, I would try to detour it. Then, (if it didn’t 
work) I’d use atomic weapons to move it, or to make 
it detour. 

One of two things could be done in this case. You 
could either move the town or dynamite the ice. By dynamit- 
■’ng the ice you break it up into smaller pieces which will 
melt easier, come the spring thaw. 



Examples Score 2 



I would try to stop the glacier by using explosives. I 
would try to halt the progress by destroying a part of 
the glacier every few days. 

I would try to stop it by using a system of heat or hot 
water to melt the glacier and slow its progress. 

1 would try to build a large ”man-made" moiintain in the 
path of the glacier in order to divert it. 

Since rough ground breaks up glaciers, I would make the 
ground as rough as possible to break the glacier up. I 
would build some type of dam, and when the glacier got 
pretty near, I would use artificial heat to melt it, and 
let the water go into the dam. 

Some way would have to be found to destroy the glacier. 

This could be done my melting it or using explosives. A 
chemical could be put on it, causing it to melt. Of course, 
the problem of the melted ice would arise and the water 
would have to be disposed of. By using an explosive, the 
glacier could be broken down and the mov( 2 ment stopped. 



Examples Score 3 



Dig a drainage ditch near the glacier to carry off excess 
water. You might run it through a hydro-electric plant, 
use it for irrigating fields , or for drinking water; then. 
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manufacture a big solar mirror and focus on the ice to melt 
it. 

First, I»d find out what was causing the glacier to move, 
then if it were going to cause mors movement, I would destroy 
the source. If destroying the source didn’t work, I would 
plant explosives at several points in the ice pack. Then, 
let them explode and smash the ice. Then I would set up a 
system for removing the ice. If this didn’t work, I’d try 
to push the ice into an ocean current, or, if there were no 
ocean, I would try to melt it with a heat source such as a 
la' ' ma^ifying type cover that would cause the sun’s rays 

T/O • 

In the year allotted you could erect a large coil a little 
in advance of the glacier. Behind this a ditch could be 
dug. Drop the ditch off to form a water- fall and put up a 
hydro-electric plant. Using an outside source, start 
electricity through the coil. This will require many millions 
of volts. Once the glacier begins to melt, it will move 
faster, making more of it to melt. After enough water is in 
the ditch, open the end and let it fall on over the edge of 
a cliff or mountain into the hydro-electric plant. If no 
mountain is handy, it will be necessary to construct a man- 
made water-fall. This water will turn the turbines and 
create electricity to run the heating coil. 



Examples Score 4 



Dig a great drainage ditch to catch the run-off. Then, set 
up a great water network all over the glacier which would 
spray water over the freshly fallen snow and melt it. This 
would, also, melt through the glacier in many places, cutting 
it up into smaller pieces. This would go on until the 
glacier had completely melted and, of course, would stop 
its advance by lightening the amount of bulk ice in it. 

Build an artificial lake of immense size, miles from the 
town and build a dam for it and a hydro-electric plant. 

Having estimated the amoxmt of water in it, with immense 
laser beams, melt the front of the glacier carefully so as 
not to cause a flood. As the water reaches the dam it will 
build up slowly and eventually flow out, at which time the 
hydro-electric plant will convert the energy into electrici- 
ty. This water could be run off by a series of canals. It 
could be used for irrigation, reservoirs and the remaining 
water would have to be distributed to areas further away. 

The electricity created would not only enable all this to be 
done electrically, but it would, also, eventually more than 
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pay for the amount spent to stop the glacier. The water 
in the glacier would he melted as far back as they wanted, 
and if kept melted back into a valley, they could melt 
it as it rises out of the valley. 

Item 86. He is a professor of English at a large 
University c 



E xamples Score 0 



Qualified - He would also know about science if he is 
well educated. 

Not qualified - He would be more interested in soeliing 
and grammar. 

No effect - He could read about it in a book. 



Examples Score 1 



Qualified - This shows he could write a good article if 
he wanted to. Anyone could look this up in a book. 

Not qualified - All of his training would be in 
literature and not much is written about science in 
literature. 

No effect - Glaciers may be a hobby of his or he might not 
even know what one is. 



Examples Score 2 



Qualified - 



Not qualified - Since he is a professor of English neople 
wouldn*t believe him even if he wrote a good article because 
he is not a scientist. Also, he would have to copy most 
of the material and wouldn’t know wMt was correct and 
what was wrongs 



No effect - Most English teachers read a lot and have 
special interests. Maybe he would be interested in 
glaciers from some studies he had in college. 
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Item 87 * 



His books are often quoted In newspapers and 
magazines. 



Exaag)Ies Score 0 

Qualified - he must he good. 

Not qualified - A lot of people are quoted. 

No effect - Maybe he is quoted by communist papers. 

Bsamples Score 1 

Qualified - If he is quoted about glaciers then he is quali- 
fied. '' 

Not qualified - Magazines and newspapers don*t usually quote 
scientists, so he must not be one. 

No effect - This doesn't say what kind of newspapers and 
magazines. 



Examples Score 2 



Qualified - 
Not qualified - 

No ej^ect - Maybe his books are about glaciers, then this 
would make him qualified if his theories fvre right, but if 
his are about cowboys and Indians, then he would not 

be qualified. Since the question didn't sav. i do^'^*- 
what it is, so I'll say no effect. 



I^m 88. He spent a year at Thule Air Force Base in Greenland. 



Examples Score 0 

Qualified - He repaid have seen a lot of snow. 

Not qualified - The Air Force isn't interested in glaciers. 
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Ho effect - Maybe he was there in the sumtier. 



Examples Score 1 

mef h^dl ^ glaciers 

S i.*SiSSjy! ““ 

s SuTo?siK^s,'s‘ss:; i*si. 

Examples Score 2 

Qualified » 

Not qualified - 

If he was se^'’L'^8tudy*gia?i^^^^ it wouirhel^a^lor^S^^ 

JLa.s‘i."2J3 trs' “■”■* “ 

fifst article written by the 
autnor pviblished in Scientific American? ^ 

Examples Score Q 

Qualified - It has good articles. 

. iie woman 't; have enough eaqjerience. 

No effect - It might be good or bad. 

Exanc^le s Score 1 

wSi/check thi aagftzlne, and 

KM ; ?s S?SCS.!S 
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No effect - Maybe he has published a hundred articles some- 
where else. 



Examples Score 2 



Qualified - The Scientific American prints easier versions 
of complicated theories and researc^h, so this would mean 
he had a good reputation among scientists and was persuaded 
to pr^.t it where more people would see it . How many people 
read the International Glacierologist Monthly ? 

Not qualified. 

No exfect - The article should be Judged by itself >^ 4 d not 
on how many things the author has published. He may have 

put a lot of research in it or Just copied from a couple of 
books. 



Item 90, His books are often quoted by other glaciologists. 



Examples Score 0 

Qualified - He is well kjiown. 

Not qualified - They probably don*t believe him. 

No effect - He could be president of the Glacier Society. 



Examples Score 1 



Qualified - This shows that other glaciologists know of his 
work and respect his opinions. 



Not qualified - This means they don*t be lie ire him and are 
trying to show where he is wrong® 



No effect - He may be studyi^ng the small mountain 
and not know much about the polar ice caps. 



glaciers 



Examples Score 2 

Qualified - This shows that his work is well known. If other 



glaciologists quote hiui^ then his beliefs are important 
and must be known if we are to understand glaciers even 
though^ some may be trying to disprove his theory, because 
the article says there Is a broad range of estimates of the 
amoung of water in glaciers. 

Not qualified - 

No effect - This shows one of two things* Either he is 

gls-ciers or something that is closely related. 
H expert about glaciers then he is qualified: 

if about something related, then not qualified. 



Item 91. 



He won a Nobel prize for his work on the 
of Haiti. 



geology 



Examples Score 0 

Qualified - This is science. 

Not qualified - He wouldn’t know about glaciers. 

No effect - This only means he was interested in rocks ^ 



Examples Score 1 



Qualified - mis means that he is a highly skilled scientist 
and would write ahoux. a lot of areas in science. 

Not qualified - There are no glaciers in Haiti, so he 
wouldn’t have worked with them. 

No effect - Geology is affected by glaciers, so if Haiti 
ever had a glacier he would have studied about them, but 
if it never had a glacier, then he wouldn’t have. 



Examples Score 2 



Qualified -* In becoming a reco^ized expert he would have 

to^leap^about all the things that effect geology. 

Since (^lacie^'S aifect the land, he would have studied about 
them and would be qualified. s-uaxea about, 
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Not qualified - This. shows that he would have specialized in 
tropical lands and would not be working with glaciers. If 
he wrote about glaciers he would be talking about things he 
hadn’t studied much and might make false statements. 

No effect - 



Item 92 . He is a professor of meteorology (the study of 
weather) at a large university. 



Examples Score 0 



Qualified - He knows ' a lot about weather. 

Not qualified - He wouldn’t be an expert on glaciers. 
No effect » Maybe all he knows abou^. is clouds. 



Examples Score 1 



Qualified - Glaciers play an important pare in weather, so 
he would have studied about them. 

Not qualified - He would be more interested in how they effect 
temperature and wind and not about how the^ form. 

No effect - Maybe he is a specialist that doesn’t ha^^e much 
to do with glaciers, or maybe he specializes in the effect 
of glaciers on weather. 



Examples Score 2 



Qualified - Since the distribution of water in solid and 
liquid forms are most important in weather he would be 
interested in how the distributions are changing. Also, 
since mountain glaciers play a role in local weather he 
would have to know about them. 

Not qualified - This time would be spent in non*- glacier 
regions since there are no tmiversities on glaciers so he 
would not be able to study them. He would just teach how 
to predict weather, not about glaciers. 




No effect - 
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Item 93. His name is not included in the Directory of 
American Scholars. 

Examples Score 0 

Qualified - Scholars are philosophers. 

Not qualified - If he is qualified he would he. 

No effect - Probably a lot of other scientists* names 



Examples Score 1 



Qualified - piis is an organization of writers and poets 
so I think it shows he is probably a scientist. 

Not q^lified - He must not be very well known if this 
includes names of scientists, therefore, I would think 
him less qualified. 

No effect - If he is young he wouldn’t be well known 
enough yet, but could still write a good article 



Examples Score 2 



Qualified - 
Not qualified - 



No effect - Maybe he is not an American, or if he is 
maybe he is still in college. This doesn’t say if he 
is working on glaciers or what. 



He is an amateur mountain climber. 



Examples Score 0 

Qualified - He could get to them. 

Not qualified - He should be expert. 
No effect - Maybe he likes to walk. 
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Exang)les Score 1 



Qualified - He would climb through glaciers on the high 
mountains, and so would see them first hand.. 

Not qualified - If he is an amateur he would know the 
difference between snow and a glacier. 

No effect - Doesn*t say why; is it for the exercise or to 
study glaciers? 



Examples Score 2 



Qualified - 

Not qualified - An amateur mountain climber would stay 
away from the hard areas like glaciers and would go just 
to be outside and to look at birds, flowers and rocks. 
Professional climbers go to lead scientists to study things 
and would learn a lot themselves. 

No effect - This doesn’t say what his main job is; if it was 
related to glaciers he would have to clLimb some mountains 
secondarily to his job, but if he has a job not related to 
glaciers, then it wouldn't help. 



Item 95 . He is a recognized expert in the field of electronics. 

Examples Score G 

Qualified - He would know about a lot of things. 

Not qualified - This has nothing to do with glaciers. 

No effect - No relationship 



Examples Score 1 



Qualified - He could build instruments to measure glaciers. 

Not qualified - All of his training would be in electronics 
and engineering, so he would know little about glaciers. 

No effect - Maybe he studied glaciers as a hobby. 



Examples Score 2 



study glacier*? you have to he able 
«««• 4 Isast use, complicated instruments. Since 

*’® “®®'* anywhere else, you 
electronics to study 

Net qt^lifled - He would not be qualified because he would 
not be interested in how the weather is affected by glae-iers 

co^uters?^*^ interested Jji are things like missies and 

r *»® is recognized as an expert by his 

neighbors because of what he learned from glacier instru- 

studying, or maybe he is known because of his 
work in the space program. 



Lisbon Earthquake 



Item 8l. SiQ>pose that you had held an influential 

position in Lisbon and that you were opposed to 

the capital to Rio de Janeiro. Other influ- 
ent..al p^ple supported the proposed move. Briefly 

used in an attempt 

to convince them that the c^iWi should remain in 
ifi8oon« 

objective of this item is to force the 
to project into the situation immediately 
following the earthquake. Since the article 

instability following the earthquake, 
should point out stabilizing effects of 
^U 4 in Lisbon or the further dis- 

ruption which would be caused by moving the capitals 



Examples Score 0 

It shouldn*t be moved Just because of the earthquake. 
Lil^on? sgainst it because things were so bad in 

Lisbon is a good location near the sea. 



Examples Score 1 



®®®® 8^°^ reason why the capital 

clLate i-isbon, for example, location or 

Climate, and these reasons would still applv even thou/rh 
the city was destroyed. The city could be rebSlt. ^ 

An earthqu^e or other disaster can happen anvwhere so 

insure that the new capital would not be 
destroyed. Also, there would be a lot of mix up in moving. 

mother country unless some 

caMtal Instead of moving tSI 

capital to another country moving it to a different city. 

tradition. Then, I»d tell them 
comt^^^f IViTt capital of a country in another 
bSftte Portugese Empire 



Examples Score 2 



The main arguments I would use are; 

1. All of Lisbon was not destroyed. 

2. Ttiere were important documents and papers to be found 
and transferring everything to R5.o de Janerio would cost more 
than rebuilding the capital. 

3. This is where important officials live and they vrould 
have to move. 

Building a new capital in Rio would take longer than in 
Lisbon, because material .from damaged buildings would be 
available. Also, there would be no government for months 
while the officials were moving to Rio since ships d:ldn*t 
have radios then. 

Lisbon belongs to the mother land and the capital should not 
be moved to a colony. It*s closer too of major powers and 
commerce than Rio. It*s closer to the center of trade in 
the world and more accessible to traders and merchants. 

I would oppose the move because; 

1. Poor transportaion and communication. 

2. Portugal would become a colony and Brazil the ‘mother 
country. * 

3. South America is underdeveloped. 



Examples Score 3 



Lisbon had been the capital for so long;> and it could be 
rebuilt. The economy of Lisbon would dTOp tremendously 
because you wouldn*t have the trade and turnover of people 
you had had. Your particular business could be affected 
because the capital employs a lot of people. Your own 
personal life could also be affected in that many people 
would move and so many people have been killed that those 
surviving cannot stand to loose their friends and family as 
they need one another. 

I. Lisbon remain the capital; 

A. Lisbon is the capital, known as the capital 

(worldwide), through all books and papers — Lisbon 
is known as the capital. 

1. Earthquakes strike all over, not only in Lisbon. 

2. If another city became the capital it would 
cause many political problems, would have to 
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move out their government and replace it 
with ours. 

3 . Rio de Janeiro— ground may not be as solid 
and good as Lisbon is now since the earth- 
quake has hardened the foundation under 
Lisbon. 

4 . move and starting over would cost more 
than staying in Lisbon. 



Reasons for keeping the capital in Lisbon: 

1. Rio de Janeiro is too far from the mother country. 

We must show strength and determination by not giving ir 
to a natural disaster. xr 

countries and of our own country 
in^LiSon^ of our determination if we stay 

A?? Lisbon will feel abandoned if we leave. 

oil rebuild 



3 . 

4 . 

5 . 



Examples Score 4 



S?® M 1 moved, 1 feel, because to rebuild 

oalitil^wouid ®®"y people. TO move the 

It 5??? !v**'® people which will be needed. 

There would **'® P®°P^® ”''0 remained. 

'*® e P*ol>lem of transportation. To 

away “The sSirit^n«dB ^® not taken 

spirit needs to be raised, not lowered. If 

a^Led L Sld“t!*‘® ® 

I. Capital should be in Portugal: 

A. Brazil is too far av;ay. 

1 . Lack of com&jAn Stations. 

2. Lack of unity. 

Portuguese people should be in their 
own c jy, 

C. Moving capital would weaken Portugal, 
lie Brazil is unsuitable: 

communications, Indians, 

B. Independence Movement in .Latin America. 

be unthlhkfthiA j£ city of Lisbon J.t would 

capital to foreign city 

8tillluil"’of“M9?nt r ’recently discovered and 

still full of hostile Indians. One must think of the cost 



of such a rash move. One might also check into the back- 
ground of the people who proposed such a move; it might 

prove interesting to see how much some of them would benefit 
by such a move. 

Pombal has managed to reorganise our city. In time we may 
be better off than we used to be. Besides, the capital has 
always been there. It is in a better location here. It 
will be an awful lot of trouble to change and besides, what 
if ya decide to move it back again. "Mark my words", Lisbon 
will soon oe rebuilt into a greater city than ever* before. 
Pombal is a bom organizer. Besides, we loose control if it 
is moved to Rio de Janeiro. We will no longer be an import- 
ant city and many of you may lose your wealth and power. 



Lisbon Earthquake 



Item 82 . Suppose a politiCval cartoonist wished to medce the 
philosophy of Leibniz appear foolish. Draw or 
describe a cartoon which would accomplish the above 
purpose. 

Objective ; The purpose of this item is to force the student 
t^o translate a set of abstract relations, given in 
the reading passaige, into a concrete presentation. 



Example s Score 0 



A figure (man or animal) labeled Leibniz. Examples; The 
devil, a beggar or tramp, mule, a deformed man, a dog, etc. 

A picture of a person sating the earth with the caption 
The World is suited to our desires and appetities." 



Ebiaaples Score 1 



Drawing or description of Lisbon in a state of destruction 
with a caption quoted directly from the passage. Examples; 
Your particular misfortune is nothing, it contributes to 
the universal good" and "it will be repaired by natural 
means . 

Drawing or description showing a person in distress with the 
caption. What is, is right." or ^’It is God's will that you 
should die." 
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or description of a person living in luxury while 

right with captions; "Vfhat i^ is ^ 

«T ?oin- '*®®t of all possible worlds", or 

as possLle^^ because there is as much harmony 



Examples Score 2 



the^'caption*' ^ committing a crime witt 

be a S^nil « it is detenrdned I should 

tl thfSnerli gooS^" contributes 

taking from the rich." 

SS“a"3tt S.SS*l,r;sL‘~” *"•' ™*" 

A drawing or description of a person in distress anrf 

another person looking on saying, ”lf you die it will 
be for the universal ffoor? ” «ni 

you will be okay. ^ master plan. 



Score 



1 



ofSnL°Lf SJJrwou^"^^^^ 

Voltaire'S folgwe?^;°a^f 

p^iSriSiS IHH'nl' ^ 

tS’pSS'EffU'^ “?s; £?«8»;5'>Sic“Srf£.‘KSi;, 

substituted.) maera day problem could be 

with*an^'mciirii?$»rt^’^i?? ® civilised city contrasted 



Examples Score 4 



or description showing prosperous Individuals 

^5® caption "Leibniz is good." with 
? 2f saying "Voltaire is good." or other 

the^repressed^^ I^ibniz philosophy cannot be accepted by 

political leaders discussing the 

d^"wouw"axi«t “ the'^wo^Mrl nl^ural 

or other indication that man should not use 

as^an^area^^^^^^^^ change the major topographical aspects 

nation which follows Leibniz denies food to an 
country, and the prosperous nation has a 
r^o^■^^r^ c^ lack of trade while another prosperous 

Voltaire gives food to a similar nation 
and becomes more prosperous because of trade with the 

nation. (T’. .s could be shown by pictuies 
or Dy dock scenes with ships sitting idle 
nation and with the ships moving for the 

"bread lines" 

nation^" nations and ’work lines" for the "Voltaire 



Iter^^ The article implies that the nobility opposed 

Fombal s reforms. Suppose you were a member of the 
Portuguese nobility. In a few sentences describe 
why you would have opposed Pombal. 



O bjective ; The subject must indicate that -che reforms 

described in the article were reforms which would 
weaken the power structure in existence. Since 
descriptions of medieval life are assumed to be 
common knowledge among high school students the 
task is one of noting the consequence of reform to 
the power and prestige of t^e nobility. 



Examples Score 0 



f oppose his reforms myself if he was making the 

country a democratic one rather than a dictatorship. 

lived^*^ reforms were too modem for the time that he 
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Examples Score 1 



I would want to keep my position in life 
to share my riches with others. I like 
should I want to change? 



. I would not want 
the old ways; why 



fnswoi J^eform Which was not the 

BhouW have Seen conservative leader 



It would have taken too long to build it up. Thev were all 
ready well off and didn’t ctre about the other plop llf 

irombal would be trying to redo something in a abort time 
wMch took years to build. It would prSbaSly SeSSwv tSe 
faith the people had in the clergy and nobility if someone 

£.*s.‘;.“LT.ssr »•» 



Exaxaples Score P 



period a- form of feudal system was still in 
^^^^r.ges Pomhal would induce would destroy my 

ISSni»i nS? a member of the nobility and thus losin^my 
special privileges. I)oubtles?. 5 ly, i would refer to 

these privileges, and would oppose Pombal’s reforms* 

and'^'=vSit ““hS people would become educated. 

Ss vnAd taxation and civil law for 

Sui°tovf ?Spay^fSS\tem?”® (nobility) 

He is controlling everything his way. at least wi*h ns 

awly°f?orairthl“n^i?1?®**'*®A ***® 

imporiant part of one^f Jife? ^-eligion an 



Examples Score ^ 

f Of the nobility I feel that Pombal is out of 
to think he can do this. After all we are better 

any®hinv fo^th^*® *’°r ?*'® W should 

® them. They should be doing for us ms 

our “ach tSy Irf LyoAd 
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Pombal wanted things to happen quickly. "Good things take 
time, I say. He wanted a modem city in an old country. 
The people werehappy before, they liked their way of life. 

I feel we must get -modem* gradually, after all moderniza-* 
tion is not an overnight thing. 



Examples Score 4 



Pombal is becoming too powerful; he is over-stepping his 
ground. We no longer hold any power. All he wants to do is 
modernize. We should be content with the way things are 
instead of always trying to modernize. Many of his methods 
won’t work; he’s Just wasting his time and ours. One thing 
for sure, he’s got too much power, and some of it used to 
belong to us. 

Pombal ‘s reforms are ruthless and a product of dictatorship. 

We do not wish to sr the lower classes rise up to equal us. 

We are doing well without modernization . He is not doing 
things by the consent of the people, so why do it.. if they do 

not agree. Maybe they do not want to break tradition or 
custom. 

I, as a member of the nobility, think that P mbal’s reforms 
are a sin in the eyes of God and a curse to this country. 

The Bible says, "Ye shall be content with what ycu have and ye 
shall not covenant." This, Pombal is doing, only under the 
name of a different type. It ..s like the wolf in sheep’s 
clothing. 

Pombal^ is an arrogant opportunist who caught our government 
off-balance in the crisis of an eartheiake. He is destroying 
the culture and great traditions. We'i.ave sought for a long 
time. His dictatorial powers will soon envelope all that we 
have knovjn and our once great capital city will be no more 
than a factory run by a whip-cracker. 



Item 84. E’/ents are described differently by different people 
according to the views which they hold. Describe how 
a Lisbon priest might have described the earthquake 
and its immediate aftermath. 

Objective; This item is designed to test the students 
creative writing ability. The basic ingredients 
given in the reading passage must be reconstructed 
into a vivid description of what it might have been 
like to have w:.^tne8sed the destruction. The pro jec- 
tion into the views of a priest implies that the 
description would be one of compassion rather than 
one of detached observer. 
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E xampl es Score 0 



iie would have told about the destruction. 

He would have described it about like everyone else. It was 
back^of it^s flet?“’'‘^ getting the town 



It w.Qs a terrible thing. 

This is God ‘3 will^ and we must not lose faith. 



Examples Score 1 



*'^akes everything happen for a 
people must not have been in accord 

nS would i.ot have been destroyed, 

fhcre was so mucn evil in the city that they brought the 
aes cruet ion on themselve-: ^ 

terrible jolts of 

the v-arth and the mass rains are a warning to ail mankind. 
Be good to the Lord and he will be good to you. 

ynilea many thousands of 
people, most of whom were in churchy but, I believe that 

of such^hingf ^ not af^ld 

sent by God to show people that they have 
Sinned, They are homeless and have no food because they 
have not believed in Kim. i^ney 



Examples Score g 



saying that the disaster was the 
will of God and that God was punishing the people for 

some ^ong they had done. He may havl described thf 

+ disasters mentioned in Bible 

ci?fel then Which God brought upon various 

accoSing ?o tlfp^lSt! Pimishment, 

people in the churches reacted, 
would have told about 
going ouc ^nto whe ruins and looking for survivors and 
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helping people that were hurt and wandering around. He 
would have told of setting up relief posts for the needy. 

The poor people of siy parrish have suffered so much with 
the qualces and fires and all. It is terrible to think of 
the deaths and wounds the poor people of Lisbon have suffered. 
I pray that this shall never happen again on this earth. 

There is chaos and looting everywhere; law and order must be 
established and emergency shelters set up to care for the 
sick. 



Examples Score 3 



I was celebrating All Saint's Day in my church when around 
ten o’clock a slight tremor shook' the church. About two 
minutes later another quake was felt, and it seemed as all 
hell broke loose. Suddenly I realized the roof was going 
to cave in; and I yelled to the people to get out as quickly 
as possible as I shoved some children out by way of the 
vestry. Just as I got out a third quake hit and the church 
crumbled as if it was made of clay. For hours and hours I 
v/orked with the others trying to find survivors, giving last 
rites and praying for the dead when necessary. 

The earth shook and made terrible noises as if the end of 
the world had come, then the buildings collapsed and the 
candles in the houses which were lit in reverence, the very 
candles lit in praise, burned our people and their homes. 

In the end there was a terrible silence, the only sound was 
the moaning of the maim d and the stench of the dead. All I 
could do was to ask m/ rcy from the Lord for my people. 

The first tremor I hardly felt. The second tremor, being 
considerably worse, shook the surrounding foundations. The 
walls and floor opened into giant cracks. I noted that the 
roof appeared solid as yet. During the next few minutes the 
rc'>m was a scene of chaos. When the second tremor ceased, 

I indicated that the room be cleared. However, before anyone 
could move the third shock hit. I remember seeing cracks 
in the ceiling, but nothing further. When I came to, I 
found myself some distance from what had been a church. 



Examples Score 4 



I remember the morriing; it was very nice, with birds singing 
and the sun shining. Mass would be right on schedule at 
9:00. People were coming in and trying to find a seat next 
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to the cool stone walls of the church. My alter bov went 
out and lit the candles as I came out I ^w peopirstanSLg 
up. They were very ragged and had no shoes, but they all 
had smiling faces . Well I As the Mass was near the end 
a slight tremor. I remember because one of the 
candles fell near the alter; then, after ten or so minutes 
it happened as I stood next to the door near the alter, 

structure seemed to collapse. The next 
T J,4new someone was helping me away from the rest 

^ started to help 

with the digging it was a terrible sight to look at. 

"Th® day of reckoning has come," "The sky is falling," 

Md m-ny other things were shouted that day. But, I 
knew non® of these things were true, for the Lord said he 

s and that none would know the time. • 

hothinf ‘’® y®* ^ saw 

^ called upon the members of the church and 

to^r^WR P^syer. The church started 

^^®'* s'''eiTt4ing went black. I know not 
what happened after that. I just pray the Lord be with 
those who left the world that day. " 

approximately three pages 

in length. Attempt to summarize the entire article 
in five sentences. 

Ob^ectl^ pie major objective of this item is to force 
tP® subject to condense the article, leaving out all but 

S v?af ^ ^®®^® ^«® atudent^s aMlity 

must\e‘*lre^?w Structure. ?his sSary 

^^® ®®^® copying of a sentence from the 

since this will result in a complete 



Examples Score 0 

A disasterous earthquake started a philosophical war. 

There were three quakes, a capital was destroyed. 

The entire article deals with an argument on whether th^ 
eartnquake was for the good of the f^pie or ?of ^ne b^. 



£«xampies Score l 

struS thrertimfl?’ ^ ® ®iP®® Lisbon, an eathquake 

Struck three times. Many lives were taken and many were 



hurt, so there c^e some aid from Great Britain and Spain 

be^m^Jred aS^'a^^pn confusion, the capital was to 

appointed Minister of Foreign Affairs 

niflnnia ^ different ideas, and he 

when’au tSse 

diffl?eSt idea^fl^nn? Plfce was taking place, their spending 

ant man hart ! >'®ppenins» many different import- 

ant men had different ideas about this matter, and they all 
discussed this among themselyes. ^ ^ 

The Lisbon earthquake occurred on Noyember 1, 1755. kiiiinc 
many people and destroying towns 20 leagues away. After tL 
earthquake a man named Pombal started to rebuild Lisbon into 

Lnrsta?fm^tf Many°pmoL“hers'’SSo"S^de 

about the earthquake, how it was a good 
so of! t>rought about through bad government and 

Ihe about the earthquake itself. The needs of 

the city and the nations that helped. The rebuilding of 

phUosopLrro?';h«???’ ’^he aifeSt the earthquakfhfd on the 

article reminds us that 

nature s calamities are still with us and still threaten us. 

^ad, and medium, were all p.raying 

shfikPfl^fho^?^* of them probably sinners. 2. Earthquake 

hakes the town three times, kills thousands of people. 

j. Survivors are shocked and anew government is brought in* 

auaL°°T^"f ^"<1 the Ending of efrth^ ’ 

new goyermentf city, new modem way and organized 

new goyemments. 5. Eyeryone liyes happily after that. 



Examples Score 2 



^ tremors came on All Saints* 
^fLi I-isbon, Porbugai and killed many peoole. Fire, a 
tidal wave, looting and falling stone helped. It beaan a 

Voitaire*'^Kant'^vf ^°*’th between 

cemed^ ’ Rosseau. The discussion con- 

acUons. .nature, predestination and mankinds 

a^'leadinf cl tv earthquake destroyed 

-pr,®®°o\® f killing thousands of men, women and child- 

of this disast.?;r, food, clothinf money 
®®"t from many allies. 3) A nef ifide? 

onf t«to a niw and LtSf 

on... 4 ) The disaster caused men like Voltaire and Rousseau 
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to comment and express their ideas about the earthquake and 
about life in general. 



Examples Score 3 



In 1755 a great earthquake hit the city of Lisbon, demolish- 
ipgthe city, killing about 30^000 people, and leaving the 
surrounding area in economic turmoil. Pombal became dic- 
tator and immediately began reforms to rebuild the city. 
Pompal was successful in rebuilding, stopping pillage and 
bringing about his reforms. After the earthquake, many 
noted philosophers took note of the incident and prepared 
statements conce:ming their beliefs. No matter how 
progressive civilization becomes, natural and man made 
calamities will occur creating varied philosophical ideas. 

On All Saints’ Day in the year 1775 a violent earthquake 
occurred in Lisbon, Portugal at 10 o’clock in the morning 
while most of the population was attending church services. 
Fires, resulting partially from the great number of All 
Saints Day candles, earthquake shocks, and tidal waves 
destroyed all but the stronger new part of Lisbon. Pombal 
a politically strong man, became a dictator of a country 
without a capital. Aid was given by Britain and other 
nations while Pombal tried to prevent plague and rebuild 
Lisbon into a modern city. His reforms were opposed by 
the nobility and c3.ergy and the v/hole topic of the Lisbon 
earthquake became a subject of great controversy among 
philosophers of the time, with Rousseau and 
Voltaire arguing from a more progressive point of view, 
and with Leibniz taking the stand of *‘this is the best 
of all possible worlds predestination type of phlrlosophy. 



Examples Score 4 



On November 1, 1755> an earthquake occurred in Lisbon that 
completely destroyed the town and aLmost all. of. the people 

this confusion and despair rose a dictator* 
.^ombal, whose social reforms and plans set Lisbon back on 
ios feet and set Portugal on the road to modernization. 
Meanwhile, European philosophers and writers were dis- 
cussing the earthquake and why it happened as a matter 

Leibniz and Rousseau lead the 
belief that it happened because that was how it was meant 
to be and nothing could change, while Voltaire argued 
that man is responsible for his own destiny and the destiny 
or nis fellow man. There is no clear cut proof of which 



is rights but the discussion still goes on today and dis- 
asters are still occurring. 

The Lisbon Earthquake was one of the worst that has ever 
occurred. Thirty thousand persons were killed in this dis- 
aster which lasted about twenty minutes. Pombal, a dominant 
figure in Portuguese politics, who was appointed Minister 
of Foreign Affairs and War, made himself a leader of that 
country by helping the people of Lisbon find food and shelter 
and then rebuilding the city according to a master plan. 
Because of the catastrophe, great philosophers such as Kant, 
Leibniz, Voltaire and Rousseau, began to theorize what was or 
was not good for man and his world. 

Item 86 . He wrote a book condemning Leibniz. 



Examples Score 0 

Qualified - He would know about the earthquake. 
Not qualified - He would not write about him. 

No effect - He might agree with Voltaire. 



Examples Score 1 

Qualified - To write the book he would have found out about 
the earthquake and the damage it did. 

Not qualified - He would try to make Leibniz look bad and 
^ would not give other viewpoints. 

No effect - Leibnizes philosophy is only a small part of the 
article and he could know about the other parts. 



Examples Score 2 

Qualified - In such a book he would have to compare him with 
other philosophers of his time. Since most of the philos- 
ophy of the time was about the earthquake, he would have 
learned a lot about it. 

Not qualified - Much of the article was about the earth- 
quake itself and should be written like history. He would 
not know about the destruction of the earthquake from reading 
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about what people thought about the meaning of the disaster. 

No effect - Maybe in studying about Leibniz he read about 
the earthquake and got real interested in it and wrote about 
the earthquake^ but he. might have not been interested. Also, 
i^be he was condemning Leibniz’s philosophy v;hen applied 
to modem tjiaes so it would not have any relation to the 
earthquake . 



Item 87. He is a professor of world history at a lar^?e 
University. 



Examples Score 0 

Qualified - He would know about it. 

Not qualified - Because this is in European history. 

No effect - Some professors do not write articles. 

Examples Score 1 

Qualified - Because this is a major happening in history 
because of all the reforms so he would know about it. 

Not qualified - 

No effect - World History is a big subject and he might not 
be interested in Portugal. 



Examples Score 2 

i' 



Qualified - Because- he would have a lot of knowledge about 
how it changed history and would have books to look up 
what didn’t remember. The philosophers in the article 
are studied in history so he would know about them too. 

Not qualified. 

No effect. 



Item 88. He is a retired 



junior high school librarian. 



Examples Score 0 



Qualified - He would have a college degree. 

Not qualified - Librarians do not study history. 

No effect - This article could have been written by anyone. 



Examples Score 1 



Qualified - Most of this article is taken from books and he 
would know how to look them up. 

Not qualified - Junior high school libraries do not have many 
books on this subject, so he would not even knov/ about it. 

No effect - This shows that he has the ability to write the 
article, but doesn’t mean he was interested in it. 



Examples Score 2 



Qualified - Librarians spend most of the time working with 
books so he would have a lot of information already. After 
working with books all of his life he would know a lot about 
how to write and could easily look up the infomation and 
write an article. 

Not qualified - To write £in article like this you would have 
to know a lot about all the philosophers who wrote about 
the earthquake and about the earthquake itself. A librar- 
ian would just take what someone else had written about 
these things and shorten them. 

No effect - This says nothing about his interest and 
knowledge of the history and philosophy of the 17 and l8 
hundreds. If he v/anted to he coiM write the article if he 
went to a big library to look up the information, but it 
doesn’t say he did. 



Item 89. He has never been outside the United States. 

wt33ctmmmti»9mmmmess:Sa» 

Examples Score 0 

Qualified - Most authors haven’t, but write good books. 



8o 



Not qualified - He would have to see it to write about it. 
No effect - People who write about Mars haven’t been there 

v/ilOX* • 



Examp les Score 1 



Qualified - If he went there he v/ould hear about the 

through accounts that had been handed down and 
would not write a true story. 



records!*^^^^^ ~ to go to Portugal to find old 

be much^Llp!’^ ^^appened so long ago that going there wouldn’t 



Examples Score 2 



Qualified - 
Not qualified - 

earthquake happened so long ago it 
would not do any gooa for him to go. All of the ruins 
r(;aoved,s rebuilt or grown over with grass, so 
he could stay here and find out just as much. 



Item_^0^ He lived in Portugal until he was 25 years old. 



Examples Score 0 

Qualified ~ He could have seen it. 

Not qualified - He wouldn't kno^f the philosophy. 
No effect - He might not have heard about it. 



Examples Score 1 

Qualified - Hs would have studied about it in history. 



I 



8l 



I 



~ would be more interested in the damage 
than the philosophy which followed it. 
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Examples Score 2 

than^fn^fr,,', would be studied more in Portugal 

recSrd^s S? SS^L^^Sdyf ^ 

■ ^ooause if he had heard of it, he would onlv 
death of his ancestors and would be biased ^ 
against Leibniz who said their death was good. ^ 

he effect because even though 

qLlified^thL*l'^fm®f <? '^e woul(’ be no better 

was i^our hStoiTbook! 



Item_21o He wrote this article while 
in a small towr.',. 



teaching social 



studies 



Examples Score 0 

Qualified - This is part of social studies. 

Not qualified - Because he wouldn’t. be smart enough. 

hls^life! " ® of 



Examples Score Ji 

t^hi^ilnd'hf 3 

wouiritevf ; Mg\Sri?y!^'-" ^ 

bSt"K ;asn.t\hS Kuldn^t?" 



Examples Score 2 



Qualified - Teachers are always looking for things for 
students to do for outside work and being a social studies 
teacher he might have found some information on it. After 
he xo^d the information^ he wculd have been able to write 

a good article because of all tne writing he had to do in 
college. 

Not qualified - 



No effect ‘ He may have taken a lot of courses in European 
history in college and found a lot of stuff to write and 
took the job so he would ha/e time or he might have just 
been smart enough to get a degree and couldn’t get a job 
in a big city wliich have good schools. 



Item 92^ He is a well known philosopher and has written 
many booi’s and articles. 



Ex.amples Score 0 

Qualified - This has a lot of philosophy. 

Not qualified - He probably never heardof Lisbon. 
No effect - His books may be about science. 



Examples Score 1 



have a good background from his 
studies about Voltaire and Leibniz, 

~ ? be is well known he probably is v/riting 
popular philosophy and is not interested in old philosophies, 

A doesn’t say if he is also interested in 
nistory and natural disasters of the past. 



Examples Score 2 



Qualified ** In all of his work he would have studied a lot 
about the philosophers in this article and used their views. 
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When figuring out their philosophy he would 
were talking about the earthaualte and would 
about the earthquake. 



have noticed they 
have learned 



would be writing against one of the 
philosophers in the article so would change v/hat happened 
after the earthquake to fit his view. 



No effect - He is a good v/riter but so are a lot of other 
people; so the only thing is if he liked to write about the 
earthquake and this doesn’t say if he did or didn’t. 



Item 93 . He is a well knovm author of historical fiction. 



Examples Score 0- 



Qualified - He knows how to write. 

Not qualified - Fiction isn’t true. 

No effect - He could still write the truth. 



Examples Score 1 



Qualiiied - Historical fiction ,is based on ti*ue happenings, 
so he would know about the real happenings. 

Not qualified - He would make up things to make a better 
story. 

No effect - He might be writing- about the Old West or 
Europe . 



Examples Score 2 



Qualified » This shows two things, one he knox^rs how to write 
inoere::ting stories and two, he knows a lot about history 
to make his stories show how life was then. 

Not qualified - He would not be qualified because all he 
would be interested in is what happened to people since 
this would make a good book* He would not know about the 
philosophy because this would not make good fiction. 

No effect - 
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i[S®2L2ii* Ppmbal and he were good friends. 

Examples Score 0 

Qualified •• He would have seen it. 

Not qualified - He would be against reform. 
No effect - Pombal had a lot of friends. 



. Examples Score 1 

No effect - He might not even know how to read and write. 



Examples Score 2 



Qualified - He cc/uld have seen the damaee talkp^^ -f-n 

direcu^fwm opinions about P^mbal'a rafonss 

SsSb;"?*;; isrs."*'* ““ *“'»«' ■“» 
thf i??o\S wHiSef 

his^mend"and^wL*^also^in the^sS”^ friend or maybe he was 

it doesn't say if h» wL ?nterpf?IfT®"h, 

What all of tL wriUn^wS K Pl^H^^ophy which is 



It^ 9g. ge has been blind since birth. 



Examples Scorft o 



Qualified - He could better understand 



suffering. 



Not qualj.fied - He couldn't &ee the destruction. 
No e-fect - He could listen to records. 




Qualified - 

would have a hard time learning to read 
Braile well enough to find all the facts. 

No effect - He could use Braile. 



Examples Score 2 



Qualified - 
Not qualified - 

tLt^Sni fln remains would be gone now anyway so 

of tfie stuff in 

mvone records he could do the research as well as 

wone if he could geo the council of the blind to pay for 
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Stages of Economic Gro;?th 



Item 8l. 'Suppose that you are a national leader in 

Australia. Describe some of the things that could 
be done to enable the country to reach maturity," 

Objective ; The objective of this item is to test the 

students realization that even though Australia 
is in high mass-consumption, some phases of its 
economy are weak. The reading passage implies 
that it reached high mass consumpt5,on by neglecting 
to develop its industrial capabilities, therefore, 
things could be done to make a sounder economy. 



Examples Score 0 



I would increase social security payments, 

I would start a program to export raw materials. 



High Mass Consuiap. 

oion and will reach Maturity in a few years. 



raw^ma^erials^ conquer more land so we would have more 



Exam ples Score 1 

" * 'll I 



kinds . Build new schools, and start 
improved education system. I would try to 
educate everyone, and teach them skills besides farming, 

schools. New factories 
countries on importing and 
complex tools and chemicals more 
transportation as railroads and waterways, 

could be expanded and trade stepped 

education could bo emphasized more. 
ro?hef couSlr?es!“" developed snd made available 

for oould be built to compensate 

In all^Srfot!f*^‘ educational institutions 

in all aspects. (3; Encourage industrial in'^estmenu and 
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reinvested in the industries therefore 

Placef on“thf maturity. (Emphasis should be 

P^‘-'‘^wction of consusier goods in order to 

more^sMiied”lnhH^ain®5^ ■ factories provides 

more stilled Jobs and decreases the unskilled labor. 

Examp leo Score 2 



1 would con.duct a c^paign to malr.e the people realize how 
^portaut investment is in making our nation a ISong sad 

neSlf ahnnV"+h^°^‘‘ ^ schools to educate 

how^to '"‘®? machines and their usefulness and also 

for organiLtiln'of isboif movement 

The first thing that would be needed to be done, v/ould be to 
increase the technical skills of the peopL. 

have to be started that taught how to make, use, and repair 

factorfp^^'^i?^^* 4 -?" would be encouraged to start 

rest of thP wo^?5 of exporting and trading with the 

rest of the world would have to be stepped up. defter 

to^makf salaries should be instituted 

to fli&ke the factories dosirable to work in* 

^2 maturity, will have to develop 

tradP^^ strive to enter international 

rt foreign goods to promote home 

indufitr^* T+ mechanize farming to allow more work in 

increasingly aware of the .tact that 
ino.ustria lization is all- important. 



Examples Score 

^step baekttiS'^«®^?+ variety of goods produced. II. Maybe 

t®iS alf *TIT /decrease benefits put to indus- 

*iew businesses. .XV. Give aid 

wUbtorid -y®®!- 

V indicate recognition 

Australia is in High Mass Consump- 
tion at th«^ •pjT’osont time . ) ^ 
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As leader, 1 would invest more money in scientists and their 
experiments, fhe money could be used most in experiments 
dealing with new chemicals that could lead the country 
toward ‘producing many of the tUngs r/hich are necessarily 
imported c Ali^o, more mon^j vjould go to persons experimenting 
with new industry. I would also want to invest much of the 
money to industries that will bring in more money for the 
government. Education would play a very big pare, also. X 
would have better schools built, more technological schools 
than anything el?e. 

First, I would start improving technology througix schools 
and research, probably with government help. In order to 
decrease the number of people needed in agriculture and 
therefore increase the number of potential skilled 
industrial workers I would promote research for better 
methods of food production. I would also encourage the 
national investment to increetse through better banking 
service and increase real wages of the workers* 



Examples Score 4 



If I were a national leader in Australia, I would try to get 
the government to support scientific research for technical 
improvements in farming and manufacturing methods. New 
industries of the desired kind, such as those manufacturing 
machine tool?, chemicals or precision instruments, could 
be given tax exemptions., Tai-iffs could be raised" to 
protect the infant industries. There would be social 
legislation to protect the workers^ minimum wage laws and 
social, security. Treaties with other nations and the 
^ormation of reciprocal trade agreements would help us to 
secure a place in international trade. 

Since it has gone through take off and par^.sed through high 
mass cons^ption. an Inbetv/een stage needs to be organized. 
It would f4>rst be oepeficial to mechanize agriculture both 
to provide food for home use and possibly oxport. Meehan- 
izavlon would also free agricultural workers to work in 
newly established industries. I would make protect these 
new Industries with Import taxes. Another e.xtfemely 

factor would be increased and improved educational 
fac 11 ..ties, providing both general and technical skS.lis for 
the population. 



Item_^. Political campaigns are based on issues that are 
in^ortant to the citizens. If you were running for 
office in a, country which was in mss-turity 
what promises would you make in an effort to win the 
election? 
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Ob.lective: The objective is for the student to realize that » 

a country in maturity is moving toward the goals of 
high mass consumption. Therefore^ the emphasis 
would be on the availability of consumer goods and 
include a program to combat depression, and insure 
fiature economic security for individuals. 



Examples Score 0 



New industries would be established to make your life 
easier with their new conveniences. The men will be treated 
fairly with the management of their companies. Our needs 
will be less expensive vyith most of our goods being made in 
our country. 

(1) A world leading power. (2) New technological advance. 
(3) Higher middle class and middle class almost equal to the 
present wealthy c3.ass. (4) Make our country better. 



Build new factories with better machines to employ more 
people. 



Examnies Score. 1 



A society in maturity has a working force mainly jn industry. 
Tlierefore^« promises which v/ould benefit manufacturing and 
industry would be in order. Plans favoring unions^ higher 
wages, and increased security would be inclined to capture 
the majority of the votes. 

I would promise the factory workers higher wages ~and 
greater social security benefits. X would reduce th<^ cost 
of living. 

I would promote the school system. X would make promises 
that would help the country socially and politically. 

Further state welfare. Make possible better jobs and more 
jobs for the people. 

I would increase social legislation designed to redistribute 
incorae, promise shorter working hours, and Increase social 
security". I would also promise to make consumer goods more 
available. 






I 
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Sxan5)les Score 2 

promise a buildup of the nation's defenses and 
offensive ability; X would promise- social legislation to 
u€^tter working conditions; provide some sort of a welfare 

security, medicare, or 

thing. I would also try to increase the pro- 

other increasing trade relations with 

HkiiLrf encourage more education to train 

®^ill6d people to put out more products . 

theri^^oerfoLw greater fruits of the labor 

of iivin/ better standard 

i SrHSlr 

f^nSSf 3 «s st.irs,?"*’' 

prSosp^ldeL^ wouldn't make any promises - I would 
areL ' J’ unemployment. S. Clear slum 

education: “°"®y 

pwgr^ Ssion°’'®i°wi?f a social securiti, 

wonif^^^^«fo and Closer ties with foreign countries? I 
leisure^Ti!^.^®4-?° possible ^ increSe the^ 

Pleasant and Ipqo^w aian in accordance with more 

Pleasant and less working hours to narallei wifh 

advancement of machinery in industry. 



Bx.8mpXes Score 3 



“ ™*w»“33S”2!“oS2r; 13^^"*®- 

otter cou^t?ies 3 fove^ent by sending technicians to 

governments 3. iduLtion®^? f?fl«ence their 

I wouXcl pi?oniis6 to consid^i^ -» 

in public buildings ^nHestau^lsf S“?on, 



91 



in rented apartments. Thus, improving the living conditions 
of the laboring class. There needs to be a specia?. scholar- 
ship fund set up so students who could not afford to stay In 
school could do so. I would investigate our Social Security 
system., and bring about changes so that it would increase the 
benefits. 

Since the people wouldn't be interested in increased technol- 
ogy, I would concentrate more on social benefits. I would set 
up a Department of Cultural Affairs to help strategically 
create cultural centers aroiond the U.S, I would have the 
Department of Inter3.or start a War on Ugliness. Probably 
more directly important to the people would be an effort by 
the government to increase the security and welfare of the 
ma^'ority of the people by federal retirement funds, unemploy- 
ment insurance, slura clearance, and housing. 



Examples Score 4 



Issues important to citizens in a pre-high mass consumption 
stage would relate and general economic security. There- 
fore I would promise a more adequate pay scale, minimum waige 
law, minimum government standards on working conditions and 
safety facilities. For economic security I would set up an 
unemployment insurance plan for those \?ho, through no fault 
of their own, cannot find work, and a retirement insurance 
plan for all citizens. Government restrictions on big 
business providing for retraining of workers who are or 
might be displaced by industrialization* Increased federal 
personal loans for education and housing. I would also set 
up a system to insure savings accounts to encoursige use of 
banking facilities and free more money for investment. 

If I were running for office I would promise to improve and 
increase education and educational facilities. The setting 
up of junior college would be good for those students who 
could not afford to leave home to attend a large university. 
Being in the laaturity stage — it would be of interest to the 
people how I felt about unemployment insurance and retire- 
ment insurance — both of which I would promise to support. 

I would also support labor unions which would be set up to 
improve the workers security and working conditions. I 
would introduce a bill to set up a plan for slum clearance 
and urban renewal, thus helping to establish better living 
conditions for the working class. Another step in this 
direction would be lov; rent federal housing projects. 

Another point I would bring out would be a tax law to help 
rsd1.stri.bute iricoms ~ - in order to help the "little man. ' 
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countries in 

in many ways and are similar 

two short lists of BianufactlirAf^^^ ways. Make 

sentative of the aanufaotuved ISs'^af f ^ 
in ta^ke-off and onp Y»aTs-^-!«l * a country 

tured goods of a couSrv'in man,ufao- 

How are your two Usts 

’ different’" aiiSe and now are t'nsv 



ec 



processing industries ?*‘'^®cting and 

ment and necessities equip- 

However. only high maa= products. 

of technical adrano^cnt S®^'' ?!*’?® benefits 

and the consumer goods toS proLc?s^"°^*°“ 



Examples Seorg o 



cotton 

steel 

manufactured raw 
m&-terials 

“take off 
s^el goods 
iron goods 
cloth 



cotton shirts 
shovels 

H®“ “aterials- 
put into use." 

H3 ^ mas s i-consump ii ion 
^^gobds ^ — - 

iron goods 
cloth 



S"irS.!g\s *'»“ 



"Take-off 

coir 

iron 

steel 

aluminum 



raw materials 
plastic 



cloth ( imported ) 
cars ' 

clocks and watches 
jewelry 






Examples Score! 



Take-o ff 

textiles, steel products 
High-mass-consumptlon ^ 

mac Hines, glass, 33^1. materials home utilities 



The two lists should he basically the same* excent the» lattfi'r 

dIvelop“iusrthe^ba^4 developed items. The take-off stage ' 

co&sm-ttin ?! *he mats 

consumption, ».herc is a demand for many various items. 



Take-O ff 

fraclors 

Plows 

Horse Carts 
Stoves 



High Mass- Consumpt ic-n 
Tele vis ion sets ““ 
Automobiles 
Lawn Mowers 
Electric Ranges 



differenc? is ‘ *>"t the main 

Hith M??! n? ^ technological advances found in the 

list, The horse cart in the Take Off 
Take Of? ?” Mass-Consumption. The stove in 

The ??lf?!®" electricity in High Mass Consumption. 

The main differences are in the advances that have been made. 



Take-Off 
Jam Machinery 
Farm Products (food) 

Factory Goods (cars, machinery) 



High Mass-Consumption 
Clothes 

Factory Products 

Machinery 

Cars 

Metals 

Defense Materials 
Transportation Materials 
Consumer Goods (household 

fumitu.re) 

Educational Needs 



starting on farm goods and factory goods, 

SnsS^Dt?or. maturity and high mfss- 
Do?Son on bigger things like defense, trans- 
portation, household goods, educational needs, etc. 



Examples Scor e 2 



Take-Off 

^5Uar^'- 

Iron 

«S»^W 

Chemicals 

AgriouXtAtral Goode 



High^ Mass -Cons u mption 
Electrical Equipment” 
Televisions 
Agricultural Products 
Greater Transportation Means 



Zn a way the two lists are alike in that they include things 
that the country uses for advancesient, but High Mass- 
Consumption is concerned more with consumer .goods than 
those of any worth to government or industries. 

I'ake-Off 
Woa 

Processed Natural Resources 
(Some manufactured goods 
such as various farm 
implements, ship for 
exporting things, etc.) 

The lists are similar in the nature of the articles although 
their quantity and quality greatly vary. Also, the luxury 
items represent a vast amount of varied industries which 
the take-off period undoubtedly lacked. 

Mass-Consumption 
luxury ftems 

More Varied Transportation 
Vehicles 
Textiles 
Dry Goods 
Marine Goods 

In Mass Consumption there are more and more varied goods 
than in Take-Off. Also, Mass Consumption tends to keep 
the same things in as there were in TakerOff, but to 
find different and better ways of making them. 



T ake-Off 

tSannecTlzoods 

Textiles 

Transportation Vehicle 
Marine Goods 



tion 

Processed Natural Pvcsources 
Luxury Items 
Poods (some) 




Examples Score 3 



Take-Off 

^teel 

Machiiiery 

Tools 



H igh Mass-Consumption 

I5e.aicine 

Caviar 

Sports Cars 



Goods man’ofactured during the take-off stage are those 
which enable increased industries and new methods. They 
are building blocy.s. During the high mass-consumption, 
the economic system has reached a balance and there is 
no longer a need for increase of industries on a large 
scale, cfenufacturers produce more luxury items to be 
consumed by the public Instead « 



T ake-O ff 
TToaT^ — 

S^eeX 

Pam Machinery 
Clothing 

Transportation (cars) 



Mass Consumptio.,. 
Steel 
Clothing 
Transportat ion 
Synthetics (rubber) 



Both lists are alike in aany ways because the needs of the 
two periods are similar in many ways such as the need for 
steel to build factories, cars, machinery and the need for 
clothing and food products for the growing population. They 
are different in the amount produced and the type produced 
e.g. synthetics such as rubber and likes for use in the home, 
for trisnsportation and for defense and the amount required 
for the population will grow with the needs of the population 
and the wealth of the population. The country in the Stage 
of high mass-consumption will need the more complex synthetics 
and the larger amount of clothing, etc., for its population 
and will be able to supply it. 



Take-Off 

^om. Wheat, Rice, Cereals 
Pam Equipment 
Crude Oil 



High Mass-Consumption 
Poods (processed) 
Petroleum Goods 
Byproducts of all Types 
Machinery 
Luxuries 



The lists are alike in the manner that the goods are basic- 
ally the same except they have been developed to a far 
greater degree in the high mass production stage. Technology 
and developnent of resources has greatly increased. 



Take-Off 

clothing 

Pood 

Household Goods 
Pam Machinery 
Raw Materials (iron, coal) 
Industrial Machines 



High Mass -Con sumption 

Clo thing 

Pood 

Household Goods 

Farm Machinery 

Raw Materials 

Machines 

Cars 

T.V. 

Household Appliances 
Colored Princess Phones 
Toys 

Luxury Items 



These lists are similar in that they both contain industrial 
and raw materials. These goods are necessary in any society 
but especially in take-off v^here they fom the basis for the 
economical change. But in Mass Consumption state these goods 
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sre n6C6Ssary to maintain this achievsmsnt but also you havo 
a lot of consumer goods which were not present in take-off. 
These come from m increased income fcvnd money flow and a 
demand for luxuries ‘ and conveniences. 



Item 84. According to the chart, not all countries spent 

the same ^ount of time in each stage, nor did they 
progress through the stages in the same order. 

describe conditions under which a country 
might be able to skip or combine stages . 

Objectj^; The student should realize the importance of 
external forces in economic development. Forces 
which radically alter typical development include 
colonization, foreign aid in wars, discovery of 

a natural resource important in the international 
market, etc. 



Examples Score 0 



'the lower stages and they have a 

start^evervthinff^roiii^ and really 

rolling. They can also combine stages 

before they 

complete it they have already started in the next stage. 

was very rich in natural resources, good 
leaders?^ ^ favorable public support and strong capable 

p they have a lot of income then it would be possible for 

consmption° as take-off and high mass- 

^ wu ^ president or someone to 

run the government well they could skip stages. 

If a country starts progressing at a very fast pace' 
progression might not cease and new and better things will 

by enter inff^the stage could possibly be skipped 

Stage bscause of not needing the time 
and progression covered in the maturity stage. 



Examples Score 1 



rLou%es?^^ tielped by foreign countries and had sufficient 



i l) 

2) Post War 

3 ) Industrial Revolution ^ 

4) Take over by another country.” ^ 

This depends upon the condition of the rest of the world, 
and the conditions of the country itself. For example — the 
country might be involved in a civil war, or there might be 
a world war in progress. Also, the inventions of another 
country might be used to help the country skip a step. 

Due to Canada's close ties with Britain the firot take-off 
I suspect that Canada was able to progress from a specific- 
ally wheat producing country to one of industrial status byj 

(1) Being close to Britain 

(2) Exporting her wheat to other countries such as U.S. and 
Britain for materials and leadership in her progression. 



Examples Score 2 



A coxontry which was not technically advanced might have a 
product which was internationally important. So that while 
increasing its manufacturing it could also develop exports 
greatly. Maturity would be reached while take-off was goj.ng 
on because the country would have basic and technical 
industries to advance at the same time. A country which 
received aid would be able to more quickly move through the 
stages of growth. A new central government which was demo- 
cratic rather than a dictatorship would seek more equality 
among the people and better national improvements. 

Countries that are developed under the guidance and aid of 
highly developed nations, tried to skip and combine stages. 
These newly-developing countries have the benefits of years 
of progress and knowledge at their disposal. They can 
receive aid from their parent country. With such benefits, 
these countries may easily develop quickly by skipping or 
combining stages. 

A new unexpected technological advancement, foreign aid in 
the form of technical advisory committees, finances, etc., 
a rapid change over in the form of government are all effects 
that might enable a coxmtry to progress rapidly by skipping 
a stage of development. 
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Examples Score 3 



Certain countries may be able to skip br combine stages 
because of interior economics and/or external factors. 

The invention of a special tool or the discovery of a 
natural resource that Was needed by another country and 
that country would help with the refining of the resource. 
You could also build up your foreign trade this way. If 
another country were to give you financial help or 
technical help— such as Peace Corps. War could be an 
external factor that would help a country to skip or 
combine stages. 

There are several possible reasons that a country might skip 
or combine stages— briefly these ares 

^1) An underdeveloped country might receive economic 
/^\ technical aid from another country, 

\ 2 ) A migration maji occur from a moi’e developed country 
for political or other reasons. 

(3/ A needed natural-resource may be found and developed 
by an outside interest. 

Australia might be a country that could skip the traditional 
period for these reasons; . . 

( 1| England could start with trained workers in Australia. 
V?/ Money not needed to build military could be. used for 
industry, education, etc. 

benefit from natural resources discoveries. 

(4; Foreign aid from other countries (Example of 
combining) 



Examples Score 4 



There ii^ always a possibility that a war, especially with 8 
more advanced society, could change the order of the stages 
Also, discovery of a new chemical or product that is in 
demand ^ countries involved in the space raoe such as a 
rocket fuel, cr a positive cure for cancer. 

Jnore advanced society by colonization, 
technical aid, or financial assistance such as is the 

case with Great Britain and Canada, and the U.S. Peace 
Corps. 

In war and other stress conditions a country might move by 
necessity for eurvial to a higher economic stage without 
going tlurough intermediate stages. 



"r ^i®°°'^ery-suoh as a brilliant technological advance- 
munt or a new source of revenue such as petroleum which is 
aesperately needed by other countries might enable a country 
to advance skipping usual steps. ^ 

which is a possession of a more advanced society 
which has been colonized by the mccher country would provide 
both a ready market for the co'mtry* *s goods and a source of 
technical aid to enable rapid development. 



An summary, elements which initiate a skipping or merging of 

st^es usually comes from external factors: war, colonizatior 

and natural resources. 



Suppose that you ar'j president of a country which 
is poor, underdeveloped, and in the transitional stage 
rx weaxthy nation has offered aid in any one of the 
following forms; machines, professional and techni- 
cal personnel, surplus food, or household goods and 
clothing. Choose the one form of aid which you 
think would produce the greatest long term benefits 

*or your country, and tell why that form would be 
more beneficial than the others. 

student should recognize the impact of basic 
necessities for a developing nation and the relative 
vaxue of each, for present relief as opposed to 
^ture security. The purpose of the item is to 
force the student to choose between several desirable 
and necessary forms of aid and to justify his choice 
over other forms of aid. 



Examples Score 0 



because this could help us back on our feet so we 
could help ourselves. 

X would take surplus food, because i wouldn’t want my 
country to do without food. ^ 

Machines because there everybody could get a job and move 

Up • 



The second: Then the poor people who haven’t 

in a long time could rest while they worked <> 



had any food 
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I would say professional and technical i»ersorm#si 

S?'5 SK Sg?.S U"Sian.. 

^^lue food. Wl.thout food how could a person niP a 

r5S.'-,S-5.l5; ‘ *•' 

The tral^d peSle 

ESSrL‘“!S!“ S'o'sss^’js ;l «... 

“ - — mww^aw# 



Examples Score g 



li^'‘coulfshow%hrcoTOS^ 

bSt®noWf®nl®Sn^knlw\i“t^ certalnlHeip, 

the technological help would^brSeeded?*'^*^**®®' 

S tt^teiSl’^Sso^epTOSI^eM^^^ professionaJ 

from. With the proper machSM^’Tho”^^** i® started 

to furnish th-ffl wachines, the people would be able 

hold^ods M eio?2?,.^ ®»® “«e with house- 

S^ese i^S^es’^uW^aooS P~I>®‘' 

naehin«« JUf® ®°°“ advance into more 

tompiex machines and the country would etill hene?ii 



'.t. 



SS£SSKHr~S? 



Professional and teclmical person" ^1 ^uld t>e my choice 
because they could tell us how to get what we want to get. 
Also, if we got machines then they would only hold us for 
a short while. I think that we were informed of all these 
things then we would be better off in the future and we 
could do things for ourselves. 



Examples Score 3 



I would choose the machines. With the machines industries 
could be begun, trade would be increased, products would 
be* increased. There would be a greater flow of money through- 
out the country and it would be fairly evenly distributed 
so that the little man would benefit as well as the bigger 
ones. A more or less chain reaction would be begun. The 
people would work with the machines producing more pioducts, 
which woild produce more trade, which would yield more money, 
which would give more to the rich as well as the poor, thus 
making more food for all, more conveniences, and making the 
educational aspect greater^ education would make professional 
and techn.ical personnel. Thus, through machines you can 
have all the other things that were offered. 

Professional and technical personnel— I *d want my country 
to stand on its own as soon as possible and the greatest 
long range aid available is education. people would 
learn skills and be able to pass them onto their countrymen- 
once having attained this technical knowledge we would no 
longer need outsiders— once taught, we could teach others. 

Our learning of technical skills, vocations, and professions 
would not break down or wear out — it would be the greatest 
productive investment we could maUce in our greatest resource— 
our people. 

(£*m an idealist) (sic) 

I would choose professional and technical personnel. This 
would benefit my country the most because it would teach 
them how to grow for tLemselves. Machines would be of little 
value without the technical no how and surplus food would be 
of; immediate value but would soon be °used up and we would 
return to our former state. Household goods and clothing 
would help but it would do nothing to increase our knowledge, 
it could only make us better off with what m already know. 
Personnel would be the wisest choice because with It ure wll^ 
be able to prepare fo-r tiwj future while increasing present 
standeyds by ourselves. 




Examples Score 4 



X believe that professic^ial and teclinical personnel would be 
most beneficial. Machines by themselves would be useless, 
surplus food would make a healthier nation but not more 
prosperous In other ways, and while household goods and 
clothing would not give the people the initiative to work 
to gain things for themselves, professional and technical 
personnel, on the other hand, would teach the people to 
use their own capabilities which \fould in the long run 

act^lly benefit the people and their families and futuve 
families. 



The benefits of sending zjo, skilled personnel would be long 
range, extending to future v Each generation could build 
on the preceding. 



I believe I would take the profvessional and technical 

country new ways 

^ would be able to start schools with 

«ow “y people the ways of the 

new industrial society. 

I would not accept the machine, because there would be 
o one qualified to teach the people how to run them. If 

personnel, they could 
Since in most countries which are in 
the people are mainly farmers, surplus 
people would grow their own. 
household goods and clothing. It 
would help the people, but it would not advance the nation. 



Valuation Sample Responses 

Item In the mid-1930’s Jap^ui was better prepared for 
war than was China. 



Examples Score 0 



More trust. The chart says so. 

ihfv neither country had reached maturity 

they should have been equally well prepared. 



No effect. China was better prepared because of her 
extremely large population. 
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Exaaoles Score 1 



WMn*r'ta*rIke alEost reached maturity while China 

in Take-Off, so Japan wouJci be more industrialised. 

Less trust. 



Examples Score 2 

trust. According to Rostow’s chart, Japan was in 
maturity. This would mean she was developing 
mnufdj, luring and could build some materials for a modem 

stage and would have very little 

supply the^gools^" 

Less trust. 

The chart shows that Japan had almost reached 
therefore, according to his theory had more 
mt'*from*th^^fth^" *•*?" China which was not even in Take-Off. 

blerSoeivinf aS have 

ow«ir ff2?4 2 r^ from Germany or started to train its 

amct statement wouldn't necessarily 



Item 87 . 



Ho stow is an economic adv 
the United States. 



sor to the President of 



Examples Score 0 

Greater trust, if the President trusts him, he must he good. 
Less trust. I^th^ the President has the wrong economic 

No effect. Presidents can make mistakes. 



104 



Iy:^ples Score 1 



Greater trust, 
influential men 



Presidents usually pick only the most 
in their fields as advisors. 



^ss t^st. As advisor he would he most conc'^med with ii 

deve^ora^hLiy'for-"’ 



advisor he might he working in such a narrow 
fiexd that he could not see the "hig pictoe.” 



Examples Score P 



several outst®dL?lSerts®irrS?en®n^^ 

Less tr-ist. 

ks^iHF€^ y ss"S,'ss‘LS„”jf*s,? 

S.'JSSiS^1.S2 " 



developed and 

Qisappeared in the course of world history. 



Examples Score Q 



Greater trust. This shows that countries constantly charige. 
Less trust. He said countries always get better. 

onoftSy'arf countries always continue 




Examples Score 1 



Greater trust. Since 
not get to transition 
over. 



technology was not developed they could 
so they were more susceptible to take 



implies that once a central 

civiSed? control over the economy (become 

civiiizea; it wili continue to expand. ' 



No effect. His theory could not he 
nop have technology. 



applied since they did 



Examples Score 2 



states that development depends on 
permit the econczay to expand. Since 
t^hnology was not available, these countries could not 

civilizations were very much 
conquest so if they had a crop 

history repeats itself then 
of today will also fall through 
therefore, Rostow»s theory is^ 
inadequate because it does not include a stage for this. 

great civilizations did not fall 
because of economic weaknesses. Since only traditional 
reached we cannot assume Rostow to be wrong. 

”that they fell because of outsiders 



Xtem^ A particular state in the United States has 80 per 

population engaged in agriculture; howet/er, 
Che wealth and state governmental control are in the 
hands of several dozen large land owners. 



Examples Score 0 

Greater trust. This state is in the traditional stage. 
Less trust. The Iftiited States is in high mass-consumption. 
No effect. Such a state does not exist. 



I 
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Examples Score 1 



Greater trust. That state is in v/hat Rostov; would call the 
traditional stage, but we can assume that this state benefits 
Arom the higher stages._Qf the other states. 

Less trust. Rostow said that the v/ealth of countr'^es in 
high mass-consumption is fairly well distributed and few 
people are farmers and this is not t-rue, of this state. 

No effect. Hostow was conceited with the classification of 
entire countries and did not say that all sections had to 
„ be classified the same. ' , 



Examples Score 2 



Greater trust. 

Less t^st. According to Rostow* s theory this state would 
be in the traditional stage. In order for the ectMiomy to 
expand workers must be free to work in non-agricultural 
jobs. With 80 per cent of the population in agriculture, 
there would not be enough people to work as schoo"* 
teachep, policemen, mechanics, barbers, social workers, 
and all other Jobs in high mass-cunsumntion. Therefore, 
regions of the country would have to be classified 
differently and Rostow classifies entire nations* 

No This state could be the leading agricultural 

state of the nation and if it used modem methods many 
times the population of the state would be fed by its 
output. Also, since farm machinery is expensive the 
landowners would have a lot of wealth in terms of net worth 
but would have most of their wealth invested in machinery. ' 



Item go. There are several poorly developed countries that 
have been completely controlled by strong dictators 
for several decades. 



Examples Score 0 

Greater trust. They must be traditional countries. 

Less trust. In that amount of time they should have 
developed. 



o 



No effect. Since it is a traditional society controlled by 
a dictator, Rostow*s theories doesn*t apply. 



Exanqples Score 1 



Greater trust. Rostow*s conditions for the traditional 
society are fulfilled since the presence of a dictator 
doesn’t mean that the other more important conditions don’t 
exist. 

Less trust. Countries in the traditional stage are, accord- 
ing to Rostow, supposed to have regional governments. Since 
they have dictators, I would have less trust. 

No effect. Rostow’ s theory doesn’t say how long a country 
will remain in any one stage. 



Examples Score 2 



Greater trust. Since "poorlj*- developed” can refer to a 
range of development and since a dictator can be considered 
a ’strong central government’, these countries can be 
assumed to be on either preconditions for take-off or late 
traditional. In either case Rostow* s theory is supported. 

Less trust. The very fact that dictators can inhibit the 
growth of these countries shakes Rostow’ s theory since he 
assumes that all countries grow. Also, the presence of a 
strong dictator in a basically traditional society goes 
against one of his major conditions, regional power. 

No effect. Rostow* s theory is an economic theory not a 
political theory. It doesn’t deal with the conditions which 
stop the growth of a countiy such as povrer-hungry dictators 
but only with the conditions which lead to growth. 



Item 91. Mr. Rostow is a college student who wrote the 

article as an assignment for a course In business 
economics. 



Examples Score 0 



Gref’-er tinist. 



If he is a college student he is pretty 
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tZTist. 

No effect, 
college. 



College students have a lot of theories. 
Ke might be an expert and still be in 



Examples Score 1 



were in college, he could go to 

time t^sDen/or.%»°^i®®? student he wouldn't have the 
me wou?d ® sood theory because 

ecoS\heo^'l!r^eart 

is his first clnlll if economJcsr^ ® freshman and this 



Examples Score 2 



read a blok^f cS ^at Jf f good grade. He probab] 
5t wouldn*t Ionic changing some parts so 

fL onf co^sf L wlia^ J«st 

Iteo^fb^oa^l ® consider is how true l£ the 

difference who wroi-i^i+^ then it wouldn*t make any 

io‘S‘sr^.'sr,^i^a\s s.s“ 

ssr;;.rs^«” ■”“• * >« »?^^=So5.s'S« 

— ■ — ttew nations are being created in Africa, 



deveioped^^^* Because this shows the world is getting more 

I«ss trust. Rostow says nothing about new nations. 

No effect. Because they were not on the chart. 



Examples Score 1 



Greater trust. Because this shows that the nations are 
e^qjanding beyond their own borders and creating new nations. 

I^ss t.rust. Because new countries are not created according 
to Rostow they develop from loosely organized clans when 
technology demands it. 

No effect. Because as the tribes become more civilized^ 
they will form countries for better government. You would 
have to wait a 100 years to see how th^r progress to tell 
about the theory. 



Examples Score 2 



Greater trust. In high mass-consumption Rostow states that 
mu? O' country does is "pursuit of external power." 

This would mean that they would gain power by developing new 
nations. This is necessary to have a place to e^ort goods 
and to get raw ma.terials. 

^ss trust. Rostow indicates that countries evolve out of 
loosely organized groups. If creating a new neition could • 

overcome this natural evolution then his theory would be in 
error . 

No effect. Because we cannot tell at what stage they are 
being created or by whom and for what purpose. Probably the 
new nations are being formed to help fight surr anding tribes 
so they would be more military than economic purposes. 



Item 93. Mr. Rostow has two college degrees. 



Examples Score 0 



Greater tiTust, Because he has to he smart to get two 
degrees. 

Less trust. Probably they are not in steiges of economic 
growth. 

No effect. A lot of people who write articles only have one 
degree. 



Examples Score 1 



Greater trust. I assume he studied economics or else he 
wouldn*t be writing an article on it. 

Less trust. They probably are not in economics so it 
makes no difference how many degrees he has. 

No effect. What are the two degrees in? If in econbmicSy 
he would be qualified, but what if they are in mathematics? 



Examples Score 2 



Greater trust. A person with two degrees has to have the 
ability to read and write good papers. They would have 
had the chance to use the llbrar^.^ and study a lot of 
theory. One other thing with two degrees he would know 
enough not to write on something he didn^t know anything 
about . 

Less trust. From the way the article was written, it 
sounded like the person majored in History and if' he did 
I would not trust his theory any more than anyone else. If 
he were an economics major the article would have talked 
more about money value exchange rates, gross national 
products, and real earning powers. 

No effect. You do not say what the degrees are in so I 
will say they are not in economics. In this case he would 
have the ability buTwould not have the interest or 
motivation. 



Mr. Rostow wrote his theory and drew the chart in 
the reading passage in 1930. 



Examples Score 0 

Greater trust. Because he could see into the future. 
Less trust. Times have changed since then. 

No effect. He could write it anytime. 



Examples Score 1 



Greater trust. Since the chart extends 30 years after 1930. 
he must have had the theory worked out pretty good. 

I^ss trust. He could not have predicted World War II in 
1930 so its effects on economy would not be known and may 
have changed things. 

No effect. Because his theory was general of all countries 
he could . have written it anytime „ The chart would iust 
show general trends. 



Examples Score 2 



Since the best of my knowledfje >^he chart is 
right then he would have had to have things work.^d out pretty 
well to predict in 1930* Since this is Just a short summary 
I would think he uses a lot more to predict :futu'’e economy 
«>han what is given in the article. 

Less tr?ist. Every country except U.S. and Canada have 
c^nged since I930. He would Just have bean guessing about 
all of these changes. He had to make up a time for Canada 
to reach maturity since it had not reached it but was in 
nigh mass-consumption. How could he know about World War II 
and how it affected the countries? 



No effect. 
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Item 95 » The Ihilted States has a sui^lus of agricultural 
products. 



Examples Score 0 



Greater trust. The U.S. should ha^e surplus siiice its 
agriculture is efficiently run. 

Iiess trust. A surplus doesn't Jjtid^.cnte the ”ba?.ance" 
mentioned in the article for high masS' coiisunption. 

No effect. Bostow doesn't mention anything about surplus. 



Examples Score 1 




Greater trust. The technology that produces a surplus in 
America is a ctiaracteristic of high mass-consus^tlon. 

Less trust. Because overproduction of resources doesn't 
fit the description of high mass- consumption which is 
supposed to ?Mive achieved a balanced pijoduction. 

®^f®ct. The surplus would be used to aid poor countries 
and would be deliberately planned. 



Examples Score 2 



Greater trust. According to the chart the U.S. is in 
high mass-consumption; since it has passed maturity one 
would expect that the farming technolo^r would be advanced 
enough to produce a surplus to be used in trade and in 
national emergencies. 

Less trust. If the cotantry had really achieved a true 
balance as indicated by the redistribution of income then 
we would not have a surplus because it would be given to 
the needy people. 

No effect. Rostov's theory Indicates that their major 
concern is providing for the welfare of all individuals 
and since this implies adequate food the presence of 
a surplus would not say an:^hing abo\it the theory 
unless it lasted a long period of tiiae, 
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Reliability Estimates fop Synthesis and Evaluation 



Interjudge and alternate forms 

Synthesis and Evaluation 

each^sinfrhM?« estimates were obtained for 

each Synthesis item; however, only total score rellabll- 

itles were estimated for Evaluation, Samples of answer 

drawn from one school. Answer sheets on which 
Synthesis or two Evaluation items were 

Tflit\tZl n? remaining answer sheets contain 

responses but collectively they do not 
constitute a random sample ,» ^ 

procedures were used to estimate Interlud^e 
reliability of the Synthesis items. Scores for each student 

assigned and recorded by each rater, 
computed for each pair of raters as an 
N(N^?/I between them. Thus for N Judges, 

fwas'Sed f Plsher^s z valSes? the mean 
z was computed, and li, was converted to a correlation coef- 
ficient, The bynthesls item reliabilities appear below. 



Item No. 

81 

82 

83 

84 

85 



Synthesis Item Reliabilities 

Atomic Lisbon Stages of 

Structure Glaciers Earthquake Economic Growth 



.64 

.65 

.73 

.76 

.76 



.56 

.59 

.54 

»70 

.73 



.59 

.52 

,6l 

.70 

.68 



.68 

.54 

.67 

.64 

.68 



Atomic Structure and Ola.elers 
and 50 students. Relis- 

D.vllties for the other two forms are based on six: 

Judges and fifty students, 

for subtest reXlablllty, total scores 

Z°Z '.^y^tjosis Items for each student by each rater were 
tabulated and N(N-l)/2 correlations were calculated! Mean 

technioie°”%Mr‘nr'*''" the z trsnsfoinaatlon 

taclmlque. This process was also used with the Evaluation 

ea?Ses apSa^^K!® Evaluation interjudge reliability 



•mnsKwi 



BOfi 
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Interjudge Reliability of Syntheels 
and Evaluation Subteste 

Synthesla Evaluation 

Atomic Structure , 89 

Glaciers ,72 

Lisbon .71 

Economic Growth ,79 



.83 

.75 

.81 

.72 



